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ABSTRACT 


The probability of symbol error for coherent and non-coherent detection of M-ary 
frequency-shift keyed (MFSK) signals affected by other interfering MFSK signals (co¬ 
channel interference) and additive white Gaussian noise (AWGN) in a fading channel 
(Rayleigh and Rician models) is quantified in this thesis. First, theoretical expressions are 
derived for the symbol error probability as a function of the signal-to-noise ratio SNR and 
the signal-to-interference/jamming ratio SIR. Next, using SIMULINK and the 
MATLAB/SIMULINK Communications Toolbox, we develop models to determine the 
symbol error probability for Monte Carlo type simulations. Finally, we compare the 
theoretical symbol error probabilities with the simulation’s results and identify the 
differences and their possible causes. 
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1 . 


INTRODUCTION 


A. THESIS OBJECTIVES 

The primary research question of this thesis is how the probability of symbol error 
for coherent and non-coherent detection of M-ary frequency-shift keyed (MFSK) signals 
is affected by another, interfering, MFSK signal (co-channel interference), additive white 
Gaussian noise (AWGN), and a fading channel. 

First, theoretical expressions are derived for the probability of symbol error as a 
function of the signal-to-noise ratio SNR and the signal-to-interference/jamming ratio 
SIR. Next, using Simulink and Matlab/Simulink Communications Toolbox, we develop 
models to determine the probability of symbol error for Monte Carlo type simulations. 
Finally, we verify the theoretical probabilities of symbol error with respect to the 
simulation’s results and identify any discrepancies between them. 

B. BACKGROUND 

Interference is the effect of a non-desirable signal on the reception of a desirable 
signal and can be a major factor limiting the performance of a digital communications 
system. Co-channel interference is a type of system-generated interference which refers 
to the degradation caused by a non-desirable signal of the same type as the desirable 
signal. Co-channel interference is most commonly introduced by other users of the same 
portion of the RF spectrum operating similar/same types of equipment. The frequency- 
nonselective, slowly fading channel results in multiplicative distortion of the MFSK 
transmitted signal. It is important to quantify the effects of co-channel interference and 
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fading such that measures can be taken to improve the communication system’s 
performance. To do so, we can use computer simulation, which falls into the middle 
ground between idealized modeling using formulae and hardware prototyping. 
Designing, implementing and testing hardware is expensive and time consuming, and is 
becoming more so as communication systems increase in sophistication and complexity, 
while the computing costs continue to decrease. 

Some computer simulations for an MFSK signal operating in the presence of 
AWGN and co-channel interference have already been performed, and the results are 
presented in Chapter V of [Ref 1], This thesis is the continuation and extension of the 
work presented in [Ref 1]. All the theoretical expressions derived in Chapters IV, V, and 
VI as well as the closed form solutions in Appendices A, B, and C are believed to be 
original. 

C. IMPLEMENTATION 

All the necessary system modeling is performed in the time domain and based on 
Simulink Monte Carlo type computer simulations. The probabilities of symbol error that 
indicate the system’s performance are obtained under realistic conditions and 
assumptions for different values of system’s parameters. 

Chapters HI through VI contain the corresponding mathematical procedure for the 
case that it is referred to, the models that are used for the simulation, the simulation 
results, and the verification of the theoretical results with respect to the simulation’s 
results. Finally, conclusions and recommendations for future considerations are 
presented. 
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IL M-ARY FREQUENCY SHIFT-KEYING (MFSK) 


In a digital communication system, the modulator maps a sequence of binary 
digits into a set of corresponding signal waveforms. The digital modulation allows us to 
construct signal waveforms that correspond to multidimensional vectors and signal space 
diagrams. 

One way of creating multidimensional signals is to use M equal energy 
orthogonal signal waveforms that differ in frequency. Consequently, each transmitted 
symbol is assigned a specific frequency, and the corresponding MFSK signal is 
represented as by the following equation: 

2*E 

— •COS^2-7C-^fg-l-m-Afyti-(t)j 

where: 

m = 1,2,...,M with M equal to the number of transmitted symbols 
T is the symbol duration 

E is the signal waveform’s energy during the time equal to the symbol duration T 

Af is the spacing between any two adjacent frequencies 

f c is the lowest frequency 

<]) is an arbitrary constant for the phase angle. 

A. PROBABILITY OF SYMBOL ERROR FOR COHERENT DETECTION 
OF MFSK SIGNAL CORRUPTED BY AWGN 

The symbol error probability for coherent detection of MFSK signal corrupted by 
AWGN is given by the following expression [Ref 2]: 
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where: 


E s is the energy of each transmitted symbol 


N 0 is the on-sided AWGN power spectral density 
and the Q-function is given by the following expression: 


Q(x)=^-[l-erf[-^ 

\l2l 


(2.3) 


where the error function (erf) is defined as: 


erf(x)= 




'x 


e"" dx 


(2.4) 


The s 5 mibol signal-to-noise ratio is defined as: 


SNR= lOlog 
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(2.5) 


From the last expression we get the equivalent expression: 


N 


-=10 


SNR 

20 


0 


( 2 . 6 ) 


4 



Now, we can express the symbol error probability in terms of the symbol signal-to-noise 
ratio SNR as follows: 



(2.7) 


Figure 1 is a graph of the probability of symbol error for coherent detection of 
2FSK, 4FSK, and 8FSK signals as a function of the symbol SNR. The signal-to-noise 
ratio is expressed in dB, starting froin -5 dB and ending at +20 dB. 



symbol signal-to-noise ratio in dB 


Figure 1. Probability of symbol error for coherent detection of 2,4, and 8FSK signals. 
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Using MATLAB/SMULINK and the COMMUNICATIONS TOOLBOX, we 
can develop corresponding models and perform Monte Carlo type simulations for the 
above case to verify the theoretical results. The implementation of the models, as well as 
their performance analysis, are described in [Ref 1]. 


B. PROBABILITY OF SYMBOL ERROR FOR NONCOHERENT 
DETECTION OF MFSK SIGNAL CORRUPTED BY AWGN 

The symbol error probability for non-coherent detection of MFSK signals 
corrupted by AWGN is given by the following expression [Ref 2]; 


error 


M- 1 

k= 1 


-k 


(M- 1)! 


kKM- 1 -k)! 


•(- 1 ) 


k+l 1 k-j-1 Nq 

•-e 
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where: 


( 2 . 8 ) 


E s is the energy of each transmitted symbol 


No is the one-sided AWGN power spectral density 
M is the number of the transmitted waveforms (symbols) 

Now, we can express the symbol error probability in terms of the symbol signal- 
to-noise ratio SNR as follows: 


SNR 


error 
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Figure 2 is a graph of the probability of symbol error for non-coherent detection 


of 2FSK, 4FSK, and 8FSK signals as a function of the symbol SNR. 



A SNR 16 

m 

symbol signal-to-noise ratio in dB 

Figure 2. Probability of s)nnbol error for non-coherent detection of 2,4, and 8FSK 
signals. 

Using MATLAB/SMULINK and the COMMUNICATIONS TOOLBOX, we 
can develop corresponding models and perform Monte Carlo type simulations for the 
above case to verify the theoretical results. The implementation of the models, as well as 
their performance analysis, is described in [Ref 1]. 
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III. MFSK CORRUPTED BY AWGN AND OPERATING IN A FADING 

CHANNEL 

In this chapter we consider an MFSK signal operating in a noisy and fading 
channel. First, the theoretical probabilities of symbol error are derived for coherent and 
non-coherent detection, and then, the simulation results are presented for comparison 
purposes. The Monte Carlo type simulation is performed in the time domain using 
MATLAB/SIMULINK models. Two separate cases of channel fading are examined: the 
frequency-nonselective, slowly fading Rayleigh channel and the frequency-nonselective, 
slowly fading Rician channel. 

A. RAYLEIGH FADING CHANNEL - COHERENT DETECTION 

In this section, we derive the symbol error rate performance of MFSK signals 
when these signals are transmitted over a frequency-nonselective, slowly fading Rayleigh 
channel. The frequency-nonselective, slowly fading channel results in multiplicative 
distortion of the MFSK transmitted signal. The condition that the channel fades slowly 
implies that the multiplicative process may be considered as a constant during at least one 
signaling time interval. Furthermore, we assume that the channel fading is sufficiently 
slow that the phase shift introduced by the channel can be estimated from the received 
signal without error. 

1. Theoretical Probability Of Symbol Error For Coherent Detection 

We determine the performance of the MFSK communications system by 
evaluating the decision variables that appear during signal reception. The conditional 
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probability of symbol error is the standard probability of error for coherent, orthogonal 
MFSK signal when AWGN is present: 


P 


error^*^^ ^ 




1-Q 


i 

x + — 


\ 


M- 1 

dx 


(3.1) 


where: 

r is the amplitude of the MFSK signal 
a is the standard deviation of the AWGN 

To obtain the symbol error probabilities when r is random, we must average 
Perror(r) over the probability density function of r. Since r is assumed to be Rayleigh 
distributed, its probability density function is given by: 

2 

-r 

r 

f(r)=—•e^“ for r>0 and f(r)=0 for r<0 

a 

where: 

is the symbol power of the fading information signal. 

In terms of signal’s power Psig, we obtain: 

2 

-r 

f(r)=—(3.3) 

^sig 

where: 

Psig is equal to a^. 
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Now, we must integrate the product of PenoXr) and the probability density 
function f(r) of the random variable r over all the possible values of r: 




The above integral has to be evaluated numerically. 

Figure 3 is an illustration of the symbol error probabilities for coherent detection 
of 2,4, and 8FSK as a function of the average SNR. 
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.0.699. 


'’2FSK„ 

•’4FSK„ 

P8FSK„ 


.1.58110''^. 



Figure 3. Probability of symbol error for coherent detection of 2,4, 8FSK signals in 
Rayleigh fading channel. 


We observe that the required SNR to obtain a symbol error probability of 10''* is 
about +35 dB and more when the channel is Rayleigh fading, while for a non-fading 
channel the required SNR to obtain symbol error probability of was about +12 dB. 
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2. Simulink Model and Block Analysis 

The block diagram of the Simulink model, which has been developed for the 
simulation of coherent MFSK in a Rayleigh fading channel, is shown in Figure 4. The 
implementation of the blocks of this model is described in [Ref 1] and only the 
modifications are discussed in this section. 



Figure 4. Model for coherent MFSK in a Rayleigh fading channel. 


a) Complex Rayl Fading Block 

This block introduces Rayleigh fading and has no fixed parameters. The 
fading envelope and the phase shift of the channel change with the second and third input 
port values. The first input port value is a unit-amplitude FSK modulated signal. The 
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second input is a Rayleigh distributed random scalar. The third input, which applies the 
phase variation, is set to zero since it is assumed that the receiver is capable of coherent 
detection even though the signal is fading. 

b) Gaussian Noise Generator 

This block generates two Gaussian distributed noise variables with zero 
mean value. The variance for each noise is equal to the half of power of the diffuse signal 
component, so that the resulting Rayleigh distributed random variable has a variance 
exactly equal to the power of the diffuse signal component. First, using the model of 
Figure 5, we perform a test to determine how SIMULINK evaluates the total signal 
power. 



complex_envelope 


T o Wortepace 


Sampled read 
from wtep 



Gaussian noise 
generator 


Real-lmag to Abs1 
Complex 




Complex Rayleigh fading | 
wvary para 


signoise_complex_envelope 


T0 Workspaces 


Conslanti 


Figure 5. Model for testing the power of the fading signal. 


Table 1 is a tabulation of the results obtained for the power of the fading 
signal, given different values for the Rayleigh RF power in the block Rayleigh noise 
generator. 
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RAYLEIGH RF POWER INPUT 
(DIFFUSE COMPONENT ONLY) 

POWER OF THE FADING SIGNAL 
(TEST MEASUREMENT) 

1 

1.0195 

2 

2.0390 

3 

3.0585 

4 

4.0780 

5 

5.0975 

Table 1. Results for signal’s power given difl 

[erent values for Rayleigh RF power. 


It is observed that the total RF power of the fading signal is preserved. 


Related to this, note that the noise variance parameter (noise_var) of the AWGN channel 
block needs to be multiplied by a factor of two because of the bandpass to lowpass 
transformation. The output vector size of this block is the same as the vector size of the 
seed and determines the variation of the fading envelope for the Complex Rayleigh 
Fading Block. 

3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of the MFSK system for coherent detection in a Rayleigh fading channel. Each 
simulation runs until at least 100 errors are observed [Ref 1]. The observed error number 
is a random variable subjected to statistical variations. In general, a different number of 
errors occur each time a simulation is run with a different set of seeds for data, noise and 
envelope fading. The data sequences are limited to 10^ symbols for each simulation to 
prevent ‘out of memory’ errors. As long as less than 100 errors are observed, the 
simulation sequence is repeated until a sufficient number of errors are counted. 
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a) Results For 2FSK 


The theoretical as well as the experimental symbol error probabilities for 
coherently detected 2FSK are presented in Figure 5 as functions of the average signal-to- 
noise ratio in dB. Most communication systems are designed to obtain symbol error rates 
equal or less than 10’'*. Therefore, we present results for the range of values of the signal- 
to-noise ratio from -5 dB to 35 dB. For large signal-to-noise ratios, the time needed for 
the simulation increases significantly. 



10 

SNR^r ,snr. 


20 


30 


"dB 

m m 


35 


HKK Theoretical symbol error probability 
O O Simulation result 

Figure 6. Probability of symbol error (theoretical and experimental) for coherent 
detection of 2FSK signal corrupted by AWGN in a Rayleigh fading channel. 
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In Figure 7, the difference between the theoretical and experimental 


symbol error probability is shown. 
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-5 SNRdB 35 

uDjn 

Average SNR in dB 

Figure 7. Percent difference (error) between theoretical and simulation results. 

We can easily observe that the simulation results for coherent 2FSK in the 


presence of AWGN and Rayleigh fading channel agree very well with the theory. The 
summary of the accuracy of the simulation for this case is presented below. 



SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Mean Percent Difference (%) 

2.07 

2. 

Maximum Percent Difference (%) 

16.659 

3. 

Minimum Percent Difference (%) 

-37.944 

4. 

Standard Deviation (%) 

13.558 

Table 2. Results of the comparison of the theoretical SI 

EP and the SEP obtained by the 


simulation experiment. 
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b) Results For 4FSK 


The theoretical as well as the experimental symbol error probabilities for 
coherently detected 4FSK are presented in Figure 8 as functions of the average signal-to- 
noise ratio in dB. 
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Figure 8. Probability of symbol error (theoretical and experimental) for coherent 
detection of 4FSK signal corrupted by AWGN in a Rayleigh fading channel. 


In Figure 9, the difference between the theoretical and experimental 
symbol error probability is shown. 
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Figure 9. Percent difference (error) between theoretical and simulation results. 


Again, we can easily observe that the simulation results for coherent 4FSK 


in the presence of AWGN and Rayleigh fading channel agree very well with the theory. 
The summary of the accuracy of the simulation for this case is presented below. 



SYMBOL ERROR PROBABILITY 

COHERENT 4FSK 

1. 

Mean Percent Difference (%) 

-7.788 

2. 

Maximum Percent Difference (%) 

11.721 

3. 

Minimum Percent Difference (%) 

-37.673 


Standard Deviation (%) 

13.075 


Table 3. Results of the comparison of the theoretical SEP and the SEP obtained by the 
simulation experiment. 
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c) Results For 8FSK 

The theoretical as well as the experimental symbol error probabilities for 
coherently detected 8FSK are presented in Figure 10 as functions of the average signal- 
to-noise ratio in dB. 



KKK Theoretical symbol error probability 
O O Simulation result 


Figure 10. Probability of symbol error (theoretical and experimental) for coherent 
detection of 8FSK signal corrupted by AWGN in a Rayleigh fading channel. 


In Figure 11, the difference between the theoretical and experimental 
symbol error probability is shown. 


20 


































Average SNR in dB 


Figure 11. Percent difference (error) between theoretical and simulation results. 


Again, we can easily observe that the simulation results for coherent 8FSK 


in the presence of AWGN and Rayleigh fading channel agree very well with the theory. 
The summary of the accuracy of the simulation for this case is presented below. 



Standard Deviation (%) 8.409 

Table 4. Results of the comparison of the theoreticed SEP and the SEP obtained by the 
simulation experiment. 
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Observing the results for coherent detection of 2, 4 , and 8FSK in a Rayleigh 
fading channel, we note that the simulation underestimates the theory for the 2FSK case 
while overestimating theory for the cases of 4 and 8FSK. The mean percent error for all 
the cases is less than 10%, which suggests good simulation accuracy. 


The average results for the coherent detection of 2, 4 , and 8FSK are: 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR 

COHERENT 2,4, AND 8FSK 

1. 

Mean Percent Difference (%) 

-4.21 

2. 

Maximum Percent Difference (%) 

11.162 

3. 

Minimum Percent Difference (%) 

-32.191 

4. 

Standard Deviation (%) 

11.681 


Table 5. Average results for the coherent detection of 2,4, and 8FSK. 


B. RAYLEIGH FADING CHANNEL - NON-COHERENT DETECTION 

In this section, the theoretical performance of non-coherent detection of MFSK is 
determined and compared to the simulations. 

1. Theoretical Probability Of Symbol Error For Non-Coherent 
Detection 

The conditional probability of symbol error is the standard probability of error for 
non-coherent, orthogonal MFSK signal when AWGN is present: 


M- 1 


-k 


error 


(r)= ^ 


(M- 1)! 


k= 1 


k!-(M- 1 -k)! 


(- 1 ) 


k+l 1 




k+ 1 


(3.8) 


22 




Integrating the product of the conditional probability of symbol error and the 
probability density function of the information signal’s amplitude r over all possible 
values of r, we get the unconditional probability of symbol error: 


P 


error" 


M- 1 

E 


k= 1 


(M-1)! 


1 

1 

1 A 

' a 

l+k-| 

1+— 

1 



where: 

is the power Psig of the fading information signal, 
a is the standard deviation of the AWGN 

It is convenient to express the symbol error probability in terms of the average 
signal-to-noise ratio using the following relationship: 

SNR(Jb 

signal_powe r ^sig _a 10 ( 3 .IO) 

noise_power ? ^2 


Now, the symbol error probability is given by: 


P 


error 


M- 1 

E 


k= 1 


(M- 1)! 


k !-(M - 1 - k)! 

1 SNRdB\ 

1+k- 

U + 10 / 


( 3 . 11 ) 


Figure 12 is an illustration of the symbol error probabilities for non-coherent 
detection of 2, 4, 8FSK in a Rayleigh fading channel as a function of the average signal 
to noise ratio. 
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Figure 12. Probability of symbol error for non-coherent detection of 2,4, 8FSK signals 
in Rayleigh fading channel. 


2 . Simulink Model and Block Analysis 

The schematic diagram of the Simulink Model, which has been developed for the 
simulation of non-coherent MFSK signaling in a Rayleigh fading channel, is shown in 
Figure 13. 
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Figure 13. Model for non-coherent detection of MFSK in a Rayleigh fading channel. 


The only difference with respect to the coherent case model is that the Coh MFSK 
demod baseband block has been replaced by the Noncoh MFSK demod baseband block. 
These blocs are analytically described in [Ref 1]. 


3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of MFSK systems with non-coherent detection in a Rayleigh fading channel. The 
simulation methods are the same as those of the coherent case. 


25 





















a) Results For 2FSK 


The theoretical as well as the experimental symbol error probabilities for 
non-coherently detected 2FSK are presented in Figure 14 as functions of the average 
signal-to-noise ratio in dB. 
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Figure 14. Probability of symbol error (theoretical and simulation) for non-coherent 
detection of 2FSK signal corrupted by AWGN in a Rayleigh fading channel. 


In Figure 15, the difference between the theoretical and the simulation 
symbol error probability is shown. 
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Figure 15. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 

below. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 2FSK 

1. 

Mean Percent Difference (%) 

29.084 

2. 

Maximum Percent Difference (%) 

55.672 

3. 

Minimum Percent Difference (%) 

-3.177 

4. 

Standard Deviation (%) 

20.799 

Table 6. Results of the comparison of the theoretical S] 

EP and the SEP obtained by the 


simulation. 


% Percent Error 



Average SNR in dB 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 4FSK are presented in Figure 16 as functions of the average signal- 
to-noise ratio in dB. 
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Figure 16. Probability of symbol error (theoretical and simulation) for non-coherent 
detection of 4FSK signal corrupted by AWGN in a Rayleigh fading channel. 


In Figure 17, the difference between the theoretical and the simulation 
symbol error probability is shown. 


28 


































Average SNR in dB 

Figure 17. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 

below. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 4FSK 

1. 

Mean Percent Difference (%) 

23.912 

2. 

Maximum Percent Difference (%) 

48.308 

3. 

Minimum Percent Difference (%) 

-3.516 


4. Standard Deviation (%) 19.52 

Table 7. Results of the comparison of the theoretical SEP and the SEP obtained by the 
simulation. 
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c) Results For 8FSK 


The theoretical and the simulation symbol error probabilities for non- 
coherently detected 8FSK are presented in Figure 18 as functions of the average signal- 
to-noise ratio in dB. 
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Figure 18. Probability of symbol error (theoretical and simulation) for non-coherent 
detection of 8FSK signal corrupted by AWGN in a Rayleigh fading channel. 


In Figure 19, the difference between the theoretical and the simulation 
symbol error probability is shown. 
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Figure 19. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 


below. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 8FSK 

1. 

Mean Percent Difference (%) 

25.748 


Maximum Percent Difference (%) 

39.806 

3. 

Minimum Percent Difference (%) 

3.471 

4. 

Standard Deviation (%) 

10.151 


Table 8. Results of the comparison of the theoretical SEP and the SEP obtained by the 


simulation experiment. 


31 














Observing the results for non-coherent detection of 2, 4, and 8FSK in a Rayleigh 
fading channel, we note that the simulation underestimates the theory for all the cases of 
2,4, and 8FSK. The mean percent error for all the cases is much greater compared to the 
coherent detection. 


The average results for the non-coherent detection of 2,4, and 8FSK are: 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR NON¬ 
COHERENT 2,4, AND 8FSK 

1 . 

Mean Percent Difference (%) 

26.248 

2 . 

Maximum Percent Difference (%) 

47.929 

3. 

Minimum Percent Difference (%) 

-1.074 

H 

Standard Deviation (%) 

16.823 


Table 9. Average results for the non-coherent detection of 2,4, and 8FSK. 


Comparing the theory with the simulation, for a given value of symbol error 
probability, the error in dB ranges from 0 to 1 dB for coherent detection and from 0 to 3 
dB for non-coherent detection. 
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C. RICIAN FADING CHANNEL - COHERENT DETECTION 

In this section, we derive the symbol error rate performance of MFSK signals 
when these signals are transmitted over a frequency-nonselective, slowly fading Rician 
channel. The assumption again is that channel fades slowly, which implies that the 
multiplicative process may be considered as a constant during at least one signaling time 
interval. Furthermore, the channel fading is sufficiently slow that the phase shift 
introduced by the channel can be estimated from the received signal without error. 


1. Theoretical Probability Of Symbol Error For Coherent Detection 

The conditional probability of symbol error is the standard probability of error for 
coherent, orthogonal MFSK signal when AWGN is present: 



(3.12) 


where: 

r is the amplitude of the MFSK signal 
Pnoise = is the power of the AWGN 

The above symbol error probability is conditioned on the amplitude r of 
information signal, since the channel is modeled as a Rician fading channel. The 
amplitude of the signal is modeled as Rician random variable with the following 
probability density function: 
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^ +2-Pdi, 


P-Pdir^ 


forr>0 


(3.13) 


0 forr<0 


where: 


Pdir = ocdii-2/2 is the power of the direct signal component 

Pdif = «dif^ is the power of the diffuse signal component. 

Integrating the product of the conditional probability of symbol error and the 
probability density function of the information signal’s amplitude r over all possible 
values of r, we get the unconditional probability of symbol error: 


,^^+2-Pdir 


P =1-- 
^ error ‘ 


e • 1-Qx+- 


\\M-1 

r W r 


2-JPdif^ 


(3.14) 


First we introduce the following variable transformation: 


^=jPdifdy 


(3.15) 


and obtain the following expression, which has to be evaluated numerically: 


P =1 
error ^ 


-X j j I-uM-1 ^ Pdirj j 

'■<»</.loUi. I 


-•y dxdy 


(3.16) 
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Next, it is convenient to define the ratio of the powers of the direct and the diffuse 
component as: 


R= 


dir 


P 


dif 


(3.17) 


For a given value of total signal power, we have: 

Power jiij.-!- Power djf Power signal_tota 


(3.18) 


Next, we express the last relationship in terms of the ratio of the powers of direct and 
diffuse components as: 


Power 


signal_total , „ 

—= 1 + R 


Power 


dif 


(3.19) 


The SNR is defined as the ratio of the total signal power to the noise power: 


^dir'*’^dif ^ dif 
SNR=-=-•( 1 + R) 

P • P • 
noise noise 


(3.20) 


Equivalently, we obtain: 


SNR 


dB 


Pdif SNR 10 


P„«;o^ aII+R 


noise 


(3.21) 


Substituting equation (3.19) and (3.23) into equation (3.18), we get the following 
expression for the symbol error probability: 
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Now, we are able to plot the symbol error probability as a function of the signal- 
to-noise ratio (SNR) and the ratio R of the powers of the direct and diffuse signal 
components. Figure 20 is a plot of the symbol error probability of a 2FSK signal as a 
function of the signal-to-noise ratio and for ratios of the powers of the direct and diffuse 
signal component equal to 1,4 and 10. 



Signal-to-Noise Ratio in dB 


Figure 20. Probability of symbol error for coherent detection of 2FSK signals in Rician 
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fading channel when the ratio of powers is 1,4, 10. 

We observe that the increase of the ratio-of-powers R, which means that the 
power of the direct signal component increases over the power of the diffuse signal 
component, does cause significant decrease of the symbol error probability. 

Next we plot the probability of symbol error for 2,4, and 8FSK while the ratio-of- 
powers remains constant at the value of 1, that is, equal amount of power for the direct 
and diffuse signal components. 
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Figure 21. Probability of symbol error for coherent detection of 2,4, and 8FSK signals 
in Rician fading channel when the ratio of powers is 1. 
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In the case of equal amount of the direct and diffuse power, the symbol error 
probability increases as we move from 2FSK to 4FSK and 8FSK signaling. This trend is 
observed generally for all values of R. 


2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model, which has been developed for the 
simulation of coherent MFSK signaling in a Rician fading channel, is shown in Figure 
22 . 
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Figure 22. Model for coherent MFSK in a Rician fading channel. 
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The block diagram of Figure 22 looks the same as the block diagram of the one 
for the coherent detection of MFSK signal in a Rayleigh fading channel. However, there 
are essential differences that force the fading of the information signal to follow a Rician 
distribution. 

a) Gaussian Noise Generator 

This block generates two independent Gaussian distributed noise 
variables. One of the two is a zero mean Gaussian variable, while the other has a mean 
value equal to the square root of the power of the direct signal component. The variance 
for each noise is equal to half of power of the diffuse signal component, so that the 
resulting Rician distributed random variable has variance exactly equal to the power of 
the diffuse signal component. 

The noise variance parameter (noise_var) of the AWGN channel block 
needs again to be multiplied by a factor of two to account for the bandpass to lowpass 
transformation. 

3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
for coherent detection of MFSK in a Rician fading channel. Each simulation runs until at 
least 100 errors are observed. The data sequences are limited to 10^ symbols for each 
simulation to prevent ‘out of memory’ errors. As long as less than 100 errors are 
observed, the simulation sequence is repeated until a sufficient number of errors has 
occurred. 
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a) Results For 2FSK 


The theoretical and the simulation symbol error probabilities for 
coherently detected 2FSK are presented in the Figure 23 as functions of the total signal- 
to-noise ratio in dB. 
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Figure 23. Probability of symbol error (theoretical and experimental) for coherent 
detection of 2FSK in a Rician fading channel, using ratio of powers 1. 
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In Figure 24, the difference (percent error) between the theoretical and 
simulation symbol error probability is shown. 
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Figure 24. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 

in Table IC). 



SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Mean Percent Difference (%) 

-1.9 

2. 

Maximum Percent Difference (%) 

15.005 

3. 

Minimum Percent Difference (%) 

-21.219 


Standard Deviation (%) 

8.826 


Table 10. Results of the comparison of the theoretical SEP and the SEP obtained by the 
simulation. 
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b) Results For 4FSK 


The theoretical and the simulation symbol error probabilities for 
coherently detected 4FSK are presented in Figure 25 as functions of the average signal- 
to-noise ratio in dB. The ratio of powers has been selected as 1. 
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Figure 25. Probability of symbol error (theoretical and simulation) for coherent 
detection of 4FSK in a Rician fading channel, using the ratio of powers equal to 1. 


In Figure 26, the difference between the theoretical and simulation symbol 
error probability is shown. 
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Figure 26. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 


in Table 11. 



SYMBOL ERROR PROBABILITY 

COHERENT 4FSK 

1. 

Mean Percent Difference (%) 

8.209 

2. 

Maximum Percent Difference (%) 

28.186 

3. 

Minimum Percent Difference (%) 

-6.258 


Standard Deviation (%) 

9.525 


Table 11. Results of the comparison of the theoretical SEP and the SEP obtained by the 
simulation. 
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c) 


Results For 8FSK 


The theoretical and the simulation symbol error probabilities for 
coherently detected 8FSK are presented in Figure 27 as functions of the average signal- 
to-noise ratio in dB. 
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Figure 27. Probability of symbol error (theoretical and simulation) for coherent 
detection of 8FSK in a Rician fading channel, using the ratio of powers equal to 1. 


In Figure 28, the difference between the theoretical and simulation symbol 
error probability is shown. 
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Figure 28. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 


in Table 12. 



SYMBOL ERROR PROBABILITY 

COHERENT 8FSK 

1. 

Mean Percent Difference (%) 

2.559 


Maximum Percent Difference (%) 

44.878 

3. 

Minimum Percent Difference (%) 

-31.5 

4. 

Standard Deviation (%) 

14.544 


Table 12. Results of the comparison of the theoretical SEP and the SEP obtained by the 
simulation experiment. 


Observing the results for coherent detection of 2, 4, and 8FSK in a Rician fading 
channel, we note that the simulation overestimates the theory for the case of 2FSK, and 
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underestimates the theory for the cases of 4 and 8FSK. The mean percent error for all the 
cases is less than 10%. 


The average results for the coherent detection of 2,4, and 8FSK are: 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR 

COHERENT 2,4, AND 8FSK 

1. 

Mean Percent Difference (%) 

2.966 

2. 

Maximum Percent Difference (%) 

29.356 


Minimum Percent Difference (%) 

-19.659 

i 

Standard Deviation (%) 

10.965 


Table 13. Average results for the coherent detection of 2,4, and 8FSK. 

D. RICIAN FADING CHANNEL - NON-COHERENT DETECTION 


In this section, the theoretical performance for non-coherent detection of MFSK 
in a Rician fading channel is determined and compared to the simulation. 

1. Theoretical Probability Of Symbol Error For Non-Coherent 
Detection 

The probability of symbol error for non-coherent detection of orthogonal MFSK 
signal in a Rician fading channel is given by [Ref 8]: 


M- 1 


(M-1)! R+1 


error 


S (M- 1)! 

kKM-l-k)! 1-hk 


1 — 


(R+l) 


SNR 


dB 


k=l 


SNR 


•e 


R+H-—10 
k+l 


(3.23) 
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where R is the ratio of powers of the direct and diffuse signal components R = adir^/2(Xdif^ 
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Equivalently, we can write: 



In Figure 29 the symbol error probability for the 2FSK is shown as a function of 
the signal-to-noise ratio and for different values of the ratio of the powers of the direct 
and diffuse signal components. 



Signal-to-Noise Ratio in dB 


- Ratio of Powers = 1 

" “ " " Ratio of Powers = 4 
. Ratio of Powers = 10 

Figure 29. Probability of symbol error for non-coherent detection of 2FSK signals in 
Rician fading channel when the ratio of powers is 1,4, and 10. 
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In Figure 30, we plot the probability of symbol error for 2, 4, and 8FSK while the 


ratio of powers remains constant at the value of 1. 
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Figure 30. Probability of symbol error for non-coherent detection of 2,4, 8FSK. 


2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model, which has been developed for the 
simulation of non-coherent detection of MFSK in a Rician fading channel, is not 
presented here since the only difference with respect to the coherent case is the 
replacement of the coherent demodulation block by the non-coherent block. 
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3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of non-coherent detection of MFSK in a Rician fading channel, 
a) Results For 2FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 2FSK are presented in Figure 31 as functions of the total signal-to- 
noise ratio in dB for R=l. 
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Figure 31. Probability of symbol error (theoretical and simulation) for non-coherent 
detection of 2FSK in a Rician fading channel, using the ratio of powers equal to 1. 
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In Figure 32, the difference (percent error) between the theoretical and 
simulation s)mibol error probability is shown. 



r5. SNRp ^35. 

Figure 32. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 


in Table 14. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 2FSK 

1. 

Mean Percent Difference (%) 

32.418 

2. 

Maximum Percent Difference (%) 

56.26 

i 

Minimum Percent Difference (%) 

-12.219 

4. 

-1 A 

Standard Deviation (%) 

20.305 


simulation. 


iP and the SEP obtained by the 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 4FSK are presented in Figure 33 as functions of the signal-to-noise 
ratio in dB. The ratio R is selected to be equal to 1. 
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Figure 33. Probability of symbol error (theoretical and simulation) for non-coherent 
detection of 4FSK in a Rician fading channel, using the ratio of powers equal to 1. 


In Figure 34, the difference (percent error) between the theoretical and 
simulation symbol error probability is shown. 
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Figure 34. Percent difference (error) between theoretical and simulation results. 



52 







c) Results For 8FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 8FSK are presented in Figure 35 as functions of the signal-to-noise 
ratio in dB for R=1. 
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Figure 35. Probability of symbol error (theoretical and simulation) for non-coherent 
detection of 8FSK in a Rician fading channel, using the ratio of powers equal to 1. 


Next, in Figure 36, the difference (percent error) between the theoretical 
and simulation symbol error probability is shown. 
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Figure 36. Percent difference (error) between theoretical and simulation results. 


The summary of the accuracy of the simulation for this case is presented 

in Table 16. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 8FSK 

1. 

Mean Percent Difference (%) 

25.237 

2. 

Maximum Percent Difference (%) 

49.848 

3. 

Minimum Percent Difference (%) 

-0.275 

4. 

Standard Deviation (%) 

16.521 

Table 16. Results of the comparison of the theoretical S] 

EP and the SEP obtained by the 


simulation. 

Observing the results for non-coherent detection of 2, 4, and 8FSK in a Rician 
fading channel, we note that the simulation underestimates the theory for all the cases of 
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2,4, and 8FSK. The mean percent error for all the cases is much greater than the error of 
the coherent case. 


The average results for the non-coherent detection of 2,4, and 8FSK are: 


■ 

SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR NON¬ 
COHERENT 2,4, AND 8FSK 

II 

Mean Percent Difference (%) 

29.37 

■ 

Maximum Percent Difference (%) 

51.379 

1 

Minimum Percent Difference (%) 

-4.137 

4. 

Standard Deviation (%) 

17.845 


Table 17. Average results for the non-coherent detection of 2,4, and 8FSK. 


Comparing the theory with the simulation, for a given value of symbol error 
probability, the error in dB ranges from 0 to 1 dB for coherent detection and from 0 to 3 
dB for non-coherent detection. 
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IV. MFSK SIGNAL CORRUPTED BY AWGN AND CO-CHANNEL 


INTERFERENCE 


A. INTRODUCTION 

Interference is the effect of a non-desirable signal on the reception of a desirable 
signal and can be a major factor limiting the performance of a digital communications 
system. 

Co-channel interference is a type of system-generated interference which refers to 
the degradation caused by a non-desirable signal of the same type as the desirable signal. 
Co-channel interference is most commonly introduced by other users of the same portion 
of the RF spectrum operating similar/same types of equipment. 

In this chapter we derive the theoretical expression of the probability of symbol 
error for an MFSK signal operating in the presence of AWGN and co-channel 
interference. The co-channel interference is represented by another MFSK signal added 
to the desired signal. We consider cases of both coherent and non-coherent detection for 
2FSK, 4FSK, and 8FSK communication systems. 

The computer simulations for these cases have already been performed, and the 
results are presented in Chapter V of [Ref 1]. Some of those simulation results may be 
repeated here for comparison purposes. Later on, the simulation results will be presented 
for the cases of fading signal/interference, which have not been addressed in [Ref 1]. 
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B. COHERENT DETECTION 


We consider MFSK signaling corrupted by AWGN and co-channel interference. 
The objective is to derive the expression for the symbol error probability, for coherent 
detection, as a function of SNR and the signal-to-co-channel interference (jamming) ratio 
SIR and to compare the theoretical results with the simulation results. We will assume 
that each interfering symbol is synchronized with the transmitted signal symbol (the 
“worst case” scenario). 

1. Theoretical Probability Of Symbol Error For Coherent Detection 

In MFSK signaling there are M possible transmitted symbols and we may 
consider an MFSK receiver as having M “branches”, one per symbol. The probability 
that the interference symbol is on the same branch as the signal symbol (at any given 
time) is 1/M, and the probability that the interference symbol is at a different branch than 
the signal symbol is (M-l)/M. The probability that the signal symbol will be received 
correctly is equal to the probability that: 

• 1®‘ case: the signal and the interference symbols are on the same branch and that the 
noise in any of the remaining M-1 branches does not exceed the sum of signal and 
interference symbols, and 

• I"** case: the signal and the interference symbols are on different branches and neither 
the sum of the interference and noise nor the noise in any of the remaining M-2 
branches exceeds the signal. 
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a) The Signal And The Interference Symbols Are On The Same 
Branch 

The signal space representation for the transmitted signal (Sj), noise (N), 

interference (I), and received signal (Y) in the M branches of our receiver is the 
following: 


0 ■ 


’«! ' 


o' 


"1 


’yi 

0 




0 


to 


y2 

s 

N= 

"i 

1= 

J 

Y= 

S + J + n j 

S 

yi 

0 


“M 


0 




yM 


ith symbol 


At any time instant the values of branch noises, as well as the transmitted signal and the 
interference, may be considered as independent random variables. The probability that 
the noise in any of M-1 branches will not exceed the sum of the signal and interference, 
that is the probability of correct s 5 mibol detection given that yj is received, is given by: 

P { correct decision / y} = n P(yj^y p given, yj^ 

(j^i) 

where: 

yj is a Gaussian random variable representing values in any of the remaining M-1 
receiver branches different than the i*'' branch. 


/y;\\ 


1-Q 


\oll 


M~ 1 


(4.1) 
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To remove the condition on the Gaussian random variable y\, we must 
integrate the product of the conditional probability and the probability density function of 
yi over all the possible values of yj. Since yi is a Gaussian random variable we obtain: 


correct decision 



(4.2) 


or equivalently: 


correct decision" 


, 

'yi]] 

1-Q 


\<^ll 


-[yi-(S+J)]^ 


2-0 


^2-k 


dy- 


(4.3) 


Using the transformation 


yj-CS + J) dy: 

x=- dx=- 

a a 


(4,4) 


we obtain: 


correcUdecisioiT 


1-Q x + 


S-t-U 


iM- 1 


^2-n 


dx 


(4.5) 


where: 

S and J are the amplitudes of desirable and interfering MFSK signals, respectively, and 
a is the standard deviation of the AWGN. 
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(4.6) 


(4.7) 


b) The Signal And The Interference Symbols Are At Different 
Branches 

The signal space representation for the transmitted signal (Sj), noise (N), 
interference (I) and received signal (Y) in the M branches of the receiver is the following: 
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The signal and the interference symbols are now on different branches. The probability 
that neither the sum of the interference and noise nor the noise in any of the remaining 
M-2 branches exceeds the signal (that is the probability of correct symbol detection given 
that yi was transmitted) is given by: 

P { correct decision / y j } = jQ P (y j ^y j, given., y -P (y y. <y j, given., y ^ (4.8) 

(ji*i,j;*k) 

where: 

j is the branch that contains only noise 
k is the branch that contains interference and noise. 

Since yj and y^ are Gaussian random variables, equivalently, we obtain: 


P { correct decision / y) = 



(4.9) 


To remove the condition on the random variable yj, we must integrate the 
product of the conditional probability and the probability density function of y, over all 
the possible values of yj. Since y; is a Gaussian random variable, we obtain: 




(4.10) 


Using the transformation: 


Yi-S dyj 

x=- dx=- 

a o 


(4.11) 
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we obtain: 



where 1/M is the probability that the transmitted and the interfering symbols are on the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are on different branches. 

A closed form solution is provided in Appendix A for BFSK. 




2 . 


Results For 2FSK 


Using the relationships 

SNR-SJR SNR 

a a 

we can express the symbol error probability in terms of SNR and SJR. Evaluating and 
plotting the theoretical and simulation results versus SNR and SJR, as well as the 
difference (error) between them, we can compare the theoretical performance of coherent 
2FSK with the simulation performance. 

First, in Figure 37, we plot the theoretical symbol error probability versus SNR 
with SJR as a parameter for coherent detection of 2FSK. The experimental results are 
plotted separately, in Figure 38, in order to avoid a complicated and confusing graph. 

Next, in Figures 39 and 40, we plot the theoretical and simulation results, 
respectively, for the symbol error probability of coherent 2FSK but versus SJR with SNR 
as a parameter. 

The values for the signal-to-noise and signal-to-interference ratios are chosen 
between -5 dB and +13 dB in increments of 1.5 dB. 

In Figure 37, 13 curves of the theoretical symbol error probability versus SNR are 
shown, corresponding to 13 different values of the SJR from -5 dB to +13 dB, where the 
lower curve corresponds to SJR=+13 dB and the remaining curves are in increments of 
1.5 dB. 
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Note that the symbol error probability decreases as the SNR decreases only for 
negative values of SIR. This behavior is verified by both theory and simulation. 



-5 0 5 10 

-5 SNR 13 

m 

Figure 37. Theoretical symbol error probability versus SNR, with SIR as a parameter 
for coherent 2FSK. 


In Figure 38 we show the simulation results for coherently detected 2FSK in the 
presence of AWGN and co-channel interference (jamming). The simulation runs until at 
least 100 errors are observed and the data sequences are limited to 10^ symbols for each 
simulation, so that “out of memory” errors are prevented. Whenever less than 100 errors 
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were observed in a simulation, the sequence was repeated until a sufficient number of 
errors, greater than 100, occurred. 
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Figure 38. Simulation symbol error probability versus SNR, with SIR as a parameter 
for coherent 2FSK. 


In Figures 39 and 40 the theoretical and simulation results are shown, 
respectively, for the symbol error probability versus SIR with SNR as a parameter. 

From Figure 39, we see that as the signal-to-interference ratio increases, that is, 
the interference power decreases relative to the signal power, the symbol error probability 
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initially decreases but then tends to a constant value. As the SNR increases, this constant 


value also decreases. 
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Figure 39. Theoretical symbol error probability versus SIR with SNR as a parameter 
for coherent 2FSK. 


The last observation indicates that two distinct regions of operation may be 

identified. When the interference power is less than the signal power, that is, for SJR>0, 

the signal-to-noise ratio dominates performance and the separation between the curves in 

Figure 39 increases as SIR increases. For a low SJR, that is, if the interference power is 
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larger than the signal power, the symbol error probability tends to a high constant value 
regardless of the SNR. This is expected, since, statistically, half of the interference 
symbols will be opposite to the signal symbols and will be selected by the receiver due to 
their larger power. 



-6 SJR^ 13 

Figure 40. Simulation symbol error probability versus SJR, with SNR as a parameter 
for coherent 2FSK. 


Although the simulation and theoretical curves have the same shape, the specific 
values for the symbol error probabilities differ from each other, and their relative 
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difference (in percent) is presented in Table 18. In Figure 41, the average difference or 
error for each curve is plotted versus SNR and SIR, respectively, for each set of 13 of the 
previously presented curves. 

Mean Percent Error vs SNR and SJR 



Figure 41. Mean percent difference as a function of SNR and SJR, respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

11.903 

2. 

Average Mean Difference (%) 

-6.681 

3. 

Maximum Difference (%) 

20.971 

4. 

Minimum Difference (%) 

-35.194 

5. 

Difference Deviation (%) 

9.851 


Table 18. Summary of the accuracy of the simulation for coherent 2FSK. 
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3. 


Results For 4FSK 


The probability of symbol error for coherent 4FSK as a function of SNR with S JR 
as parameter is shown in Figure 42. 



~5 0 5 10 

-5 SNR 13 

m 

Figure 42. Theoretical symbol error probability versus SNR with SIR as a parameter 
for coherent 4FSK. 


Thirteen curves for SIR values from -5 dB to +13 dB are shown in Figure 42, 

where the lower curve corresponds to SJR=+13 dB and the remaining curves are in 

increments of 1.5 dB. We observe that the symbol error probability for small values of 
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SJR is high and almost independent of the SNR. In Figure 43, we plot the simulation 
results. 



-5 0 5 10 


Figure 43. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 4FSK. 


In Figure 44 the theoretical symbol error probability is shown as a function of SJR 
with SNR as a parameter. 
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Figure 44. Theoretical symbol error probability versus S JR with SNR as a parameter 
for coherent 4FSK. 


Thirteen curves for SNR values from -5 dB to +13 dB are shown in Figure 44 
where the lower curve corresponds to SNR=+13 dB and the remaining curves are in 
increments of 1.5 dB. We observe that the symbol error probability is high for small 
values of SIR and almost independent of the SNR. Next, in Figure 45, we plot the 
simulation results. 
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SEP vs SJR with SNR parameter for 4FSK 
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Figure 45. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK. 


In Figure 46, the average difference for each curve is plotted versus SNR and SJR 
for each set of 13 of the previously presented curves. The relative difference (in percent) 
between the theory and the simulation is presented in Table 19. 
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Figure 46. Mean percent difference as a function of SNR and SIR, respectively. 

The two curves show how the mean difference (“error”) varies with SNR and 
SIR, respectively. Each value of the mean difference is the average of the differences that 
correspond to the 13 points on each of the 13 curves for the symbol error probability as a 
function of SNR (with SIR as parameter) and SIR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABn^ITY 

COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

6.888 

2. 

Average Mean Difference (%) 

-0.913 

3. 

Maximum Difference (%) 

16.334 

4. 

Minimum Difference (%) 

-18.625 

5. 

Difference Deviation (%) 

6.828 


Table 19. Summary of the accuracy of the simulation for coherent 4FSK. 
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4. 


Results for 8FSK 


The probability of symbol error for coherent 8FSK as a function of SNR with the 
SIR as a parameter is shown in Figure 47. 
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-5 SNR 13 
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Figure 47. Theoretical symbol error probability versus SNR with SIR as a parameter 
for coherent 8FSK. 


Thirteen curves for SJR values from -5 dB to +13 dB are shown in Figure 47 
where the lower curve corresponds to SJR=+13 dB and the remaining curves are in 
increments of 1.5 dB. We observe again that the symbol error probability is high for 
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small values of SIR and almost independent of the SNR. Next, in Figure 48, we plot the 
simulation results. 
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Figure 48. Simulation symbol error probability versus SNR with SIR as a parameter 
for coherent 8FSK. 


Figure 49 is an illustration of the theoretical symbol error probability versus SJR 
with SNR as a parameter. 
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Figure 49. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 8FSK. 


Thirteen curves for SNR values from -5 dB to +13 dB are shown in Figure 49 
where the lower curve corresponds to SNR=+13 dB and the remaining curves are in 
increments of 1.5 dB. We observe that the symbol error probability is high for small 
values of SJR and almost independent of SNR. Next, in Figure 50, we plot the simulation 
results. 
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Figure 50. Simulation symbol error probability versus S JR with SNR as a parameter 
for coherent 8FSK. 


First, in Figure 51, the average difference for each curve is plotted versus SNR 
and SJR, respectively, for each set of 13 of the previously presented curves. The relative 
difference (in percent) between the theory and the simulation is presented in Table 20. 
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Mean Percent Error vs SNR and SJR 



Figure 51. Mean percent difference as a function of SNR and SJR, respectively. 

The two curves show how the mean difference varies with SNR and SJR 
respectively. Each value of the mean difference is the average of the differences that 
correspond to the 13 points on each of the 13 curves for the symbol error probability as a 
function of SNR (with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

9.351 

2. 

Average Mean Difference (%) 

-3.714 

3. 

Maximum Difference (%) 

40.608 

H 

Minimum Difference (%) 

-22.223 

m 

Difference Deviation (%) 

8.582 


Table 20. Summary of the accuracy of the simulation for coherent 8FSK. 
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C. NON COHERENT DETECTION 


In this section we consider again MFSK signaling corrupted by AWGN and co¬ 
channel interference. First, the expression for the symbol error probability for non¬ 
coherent detection is derived as a function of SNR and the signal to co-channel 
interference (jamming) ratio. Then the theoretical results are compared with the 
simulation results. We will assume that each interfering symbol is synchronized with the 
transmitted signal symbol. 

1. Theoretical Probability Of Symbol Error For Non-Coherent 

Detection 

We again consider the two different cases of symbol error probability as we did 
for the coherent detection analysis. Initially, these two cases will be examined separately 
and then the combined total symbol error probability will be derived. 

a) The Signal And The Interference Symbols Are On The Same 

Branch 

The signal space representation for the transmitted signal (Sj), noise (N), 


interference (I), and received signal (Y) for a non-coherent receiver is the following: 
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In the non-coherent receiver, there is a sine and a cosine path for each of the M branches. 

At any time instant the branch noises, as well as the transmitted signal and 
the interference, can be considered as independent random variables. The probability that 
the noise in any of M-1 branches will not exceed the sum of the signal and interference, 
that is, the probability of correct symbol detection given that yi is received, is given by: 

P^correct_decisior)given_y^^=J^ P(^yj<y given, y^j [AAI) 

m) 


Our decision variable is: 


where njc and njs are gaussian random variables for the sine and cosine path respectively. 
Consequently, yj is a Rayleigh random variable with probability density function 

.y.2 

f(yj)=-^-e^'‘^ for yj^O (4.19) 

a 


So, the conditional probability of correct symbol detection is: 


P (correct_decisior) given_yj 
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yj iJ. 

-e dyj 
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(4.20) 


Using the transformation 


^=—2 dC=^.dyj 

2-g c 


4.21 


81 



we obtain 


P f correct_decision given_yj 
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(4.22) 


The random variable yj is a Rician random variable, since; 



(4.23) 


where: 

njc and njs are gaussian random variables for the sine and cosine path respectively. 
So, the probability density function of yj is: 
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•10 


(S + J)-yi 


2 

C 


for y j>0 


(4.24) 


In order to remove the condition on the probability of correct s 5 mibol detection, we have 
to integrate the product of the conditional probability and the pdf of the Rician random 
variable yj; 


P (correct_decision)= 
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dy; 


(4.25) 
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Using the following two identities 


M- 1 


= s 


(M-1)! 

-•(-!) 'e 

kKM- 1-k)! 


(4.26) 


2 2 1.2 

t-e -10(0 dt=--e 

0 2-a 


(4.27) 


we obtain the probability for correct decision: 


■(S+Jr 


M- 1 


P (correct_decisio^= e 


(S+J) 

(M-1)! ^ 1 .^2-(k+ l)-a^ 

kKM-l-k)!^ ^ k+1 


(4.28) 


So, the symbol error probability for the first case is: 


PI ^ “ P(correct_decisio^ 


(4.29) 


-(S+J) 


M- 1 


(S + J)^ 


error"® 


y (M-1)! ^ ^^k+1 1 .^ 2 -(k+l)-a (4 30 ) 

^ k!-(M- 1-k)! k+1 


Note that the above expression does not involve numerical integration. 
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b) The Signal And The Interference Symbols Are On Different 
Branches 

The signal space representation for the transmitted signal (Sj), noise (N), 
interference (I), and received signal (Y) for non-coherent receiver is: 


0 

0 


Si= 


S-cos (0) 
S -sinCS) 

0 

0 


0 

0 


N = 


” Ic 


y Ic' 



0 



” Is 




y Is 



0 



” ic 


0 


y ic 

" is 


0 


yis 

• 

1= 

• 

Ys 

• 

” kc 


J-cos (0) 


ykc 

® ks 


J-sin(0) 


y ks 



0 


• 

"Me 


0 


y Me 

"Ms . 



y Ms 


ith symbol 


kth symbol 


where i;«k 


The signal and the interference symbols are now at different branches. The probability 
that neither the sum of the interference and noise nor the noise in any of the remaining 
M-2 branches exceeds the signal (that is the probability of correct symbol detection given 
that Yi was transmitted) is given by: 


P ^correct_decision, given_yj^= 


P(yj^yi.given.yi) 


•p(y k^yi> given, yj) (4.31) 


The decision variables are: 


_ 1 2 2/2 2 
'j '^yjs -yj^jc ■'■"js 


(4.32) 
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which is a Rayleigh random variable, and 


y k=Jykc^+y +«kc)^+ +“ks)^ 


which is a Rician random variable. 

Therefore, the conditional probability of correct decision is: 
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P^correct,y 
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Equivalently, it can be written: 
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To evaluate the integral of the last expression we use the relationship: 
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where: 

Q1 (a, b) is the Marcuum Q-function. 
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The Marcuum Q-function is given by: 


( 2 

“ \a -|- b / oo 

Ql(a,b)=e ^ 
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(4.37) 


Finally, for the conditional probability of correct decision, we obtain: 



The variable yj is a Rician random variable, since: 


2 2 

rpic +yis =4 
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(4.39) 


In order to remove the condition on the correct symbol probability, we have to integrate 
the product of the above result and the pdf of the random variable yj over all the possible 
values of yj. The unconditional probability for correct decision can now be derived as 
follows: 


roo 



Using the transformation: 
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and dyj=a-dx 


(4.41) 
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we obtain 



Finally, the symbol error probability for this second case is: 


P2 =1- 
^^error ^ 
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The above integral must be evaluated numerically. 


c) Total Symbol Error Probability 

The total symbol error probability is given by: 
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totaT 
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M- 1 
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•P2 


(4.44) 


where: 

1/M is the probability that the transmitted and the interfering symbols are at the same 
branch and 

(M-l)/M is the probability that the transmitted and the interfering symbols are at different 
branches. 
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2 . 


Results For 2FSK 


In Figure 52, we show the theoretical symbol error probability versus SNR with 
SIR as a parameter for non-coherent detection of 2FSK. The simulation results are shown 
separately in Figure 53. 
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Figure 52. Theoretical symbol error probability versus SNR with SIR as a parameter 
for non-coherent 2FSK. 


In Figure 53, we show the simulation results of non-coherently detected 2FSK 
signal in the presence of AWGN and co-channel interference (jamming). 
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Figure 53. Simulation symbol error probability versus SNR with SIR as a parameter 
for non-coherent 2FSK. 


In Figure 54 and 55, we show the theoretical and the simulation results, 
respectively, versus SIR with SNR as a parameter. From Figure 54, we see that as SIR 
increases (that is, as the interference power decreases relative to the signal power), the 
symbol error probability initially decreases but then tends to a constant value. As the 


SNR increases, this constant value decreases as well. 


























BER vs S JR with SNR parameter for 2FSK 



Figure 54. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 2FSK. 


We observe again that if the signal power is larger than interference power 
(SJR>0) then SNR dominates performance and the curves become steeper for higher 
values of SNR. For low values of SJR, the symbol error probability is around 0.5, as 
expected, since statistically, half of the interference symbols will be opposite to the signal 
symbols and will be selected by the receiver due to their larger power. In Figure 55, the 
simulation results are presented. 
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Figure 56. Mean percent difference as a function of SNR and SJR, respectively. 

The two curves show how the mean difference varies with SNR and SJR, 
respectively. Each value of the mean difference is the average of the differences that 
correspond to the 13 points on each of the 13 curves for the symbol error probability as a 
function of SNR (with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABJErTY 

NON-COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

19.823 

2. 

Average Mean Difference (%) 

15.112 

3. 

Maximum Difference (%) 

45.458 

4. 

Minimum Difference (%) 

-7.939 

5. 

Difference Deviation (%) 

12.829 


Table 21. Summary of the accuracy of the simulation for non-coherent 2FSK. 
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3. 


Results For 4FSK 


The probability of s 5 anbol error for non-coherent 4FSK as a function of SNR with 
SJR as a parameter is shown in Figure 57. 
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Figure 57. Theoretical symbol error probability versus SNR with SJR as a parameter 
for non-coherent 4FSK. 


Thirteen curves for SNR values from -5 dB to +13 dB are shown in Figure 57 
where the lower curve corresponds to SJR=+13 dB and the remaining curves are in 
increments of 1.5 dB. We observe that the symbol error probability is high for small 
values of SJR and is almost independent of the SNR. In Figure 58, we show the 
simulation results. 
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Figure 58. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 4FSK. 


In Figures 59 and 60 the theoretical and the simulation and theoretical symbol 
error probability are shown as functions of SJR with SNR as a parameter. It is observed 
from Figure 59 that as SJR increases (that is, as the interference power decreases relative 
to the signal power), the symbol error probability initially decreases but then tends to a 
constant value. This constant value also decreases as the SNR increases. 
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Figure 59. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK. 


If the interference power is smaller than the signal power (SJR>0), then SNR 
dominates the symbol error probability and the curves are much steeper for higher values 
of SNR. For a low value of SJR (SJR<0) the symbol error probability tends to a high 
constant value. This is expected, since, statistically, almost half of the interference 
symbols will be opposite to the signal symbols and will be selected by the receiver due to 
their larger power. In Figure 60, the simulation results are presented. 
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Figure 60. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK. 


The relative difference (in percent) between the theory and the simulation is 
presented in Table 22. In Figure 61, the average difference for each curve is plotted 
versus SNR and SJR for each set of 13 previously presented curves. 
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Mean Percent Error vs SJR and SNR 



Figure 61. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR, 
respectively. Each value of the mean difference is the average of the differences that 
correspond to the 13 points on each of the 13 curves for the symbol error probability as a 
function of SNR (with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABILITY 

NONCOHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

18.298 

2. 

Average Mean Difference (%) 

12.465 

3. 

Maximum Difference (%) 

45.85 

m 

Minimum Difference (%) 

-14.319 

5. 

Difference Deviation (%) 

13.395 


Table 22. Summary of the accuracy of the simulation for non-coherent 4FSK. 
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4. 


Results For 8FSK 


The probability of symbol error for non-coherent 8FSK as a function of SNR with 
S JR as a parameter is shown in Figure 62. 



'5 0 5 10 


Figure 62. Theoretical symbol error probability versus SNR with SIR as a parameter 
for non-coherent 8FSK. 


Thirteen curves for SNR values from -5 dB to +13 dB are shown in Figure 62 
where the lower curve corresponds to SJR=+13 dB and the remaining curves are in 
increments of 1.5 dB. We observe that the symbol error probability is high for small 
values of SJR and almost independent of the SNR. Next, in Figure 63, we show the 
simulation results. 
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Figure 63. Simulation symbol error probability versus SNR with SIR as a parameter 
for non-coherent 8FSK. 


In Figures 64 and 65, we show the theoretical and simulation symbol error 
probability as functions of SIR with SNR as a parameter. It is observed from Figure 64 
that as the signal-to-interference ratio (SIR) increases (that is, as the interference power 
decreases relative to the signal power), the symbol error probability initially decreases 
but then tends to a constant value. This constant value decreases as the SNR increases. 
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Figure 64. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK. 


If the interference power is smaller than the signal power (SJR>0), then 
performance is dominated by SNR and the curves are much steeper for higher values of 
SNR. For a low value of SJR (SJR<0) (that is, if the interfering power is larger than the 
signal power), the symbol error probability tends to a high constant value. This is 
expected, since statistically, almost half of the interference symbols will be opposite to 
the signal symbols and will be selected by the receiver due to their larger power. In 
Figure 65, the simulation results are presented. 


100 
































-5 O' 5 10 

-5 SJR 13 


Figure 65. Simulation symbol error probability versus SJR with SNR as parameter 
for non-coherent 8FSK. 

The relative difference (in percent) between the theory and the simulation is 
presented in Table 23. In Figure 66, the average difference for each curve is plotted 
versus SNR and SJR for each set of the 13 previously presented curves. 
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Figure 66. Mean percent difference as a function of SNR and SJR. 

The two curves show how the mean difference varies with SNR and SJR. Each 
value of the mean difference is the average of the differences that correspond to the 13 
points on each of the 13 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

16.868 

2. 

Average Mean Difference (%) 

9.045 

3. 

Maximum Difference (%) 

73.764 

4. 

Minimum Difference (%) 

-18.69 

5. 

nn 1 "1 

Difference Deviation (%) 

14.238 


Table 23. Summary of the accuracy of the simulation for non-coherent 8FSK. 


Mean Percent Error vs SJR and SNR 
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Observing the results for coherent and non-coherent detection of 2, 4, and 8FSK, 
we note that the simulation underestimates the theory for non-coherent detection and 
overestimates the theory for coherent detection. The dilference in percent for non¬ 
coherent detection is much greater than the difference for the coherent detection. The 
average results for both coherent and non-coherent detection of 2, 4, and 8FSK are 
presented in Table 24. 


1 

SYMBOL ERROR PROBABILITY 

AVERAGE 

RESULTS FOR 
COHERENT 

2,4, AND 8FSK 

AVERAGE 
RESULTS FOR 
NON-COHERENT 

2,4, AND 8FSK 

1. 

Root Mean Square Difference (%) 

9.38 

18.33 

2. 

Average Mean Difference (%) 

-3.77 

12.207 

3. 

Maximum Difference (%) 

25.971 

55.024 

B 

Minimum Difference (%) 

-25.347 

-13.65 

5. 

Difference Deviation (%) 

8.42 

13.487 

Tal 

ble 24. Average results for coherent and 

non-coherent detection of 2,4, and 8FSK. 
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V. MFSK SIGNAL CORRUPTED BY AWGN AND CO-CHANNEL 


INTERFERENCE IN A FADING CHANNEL THAT AFFECTS ONLY 

THE DESIRABLE SIGNAL 

In this chapter we derive the theoretical symbol error probability for MFSK 
signals affected by AWGN and co-channel interference and operating in a fading 
channel. The co-channel interference is represented by an additive interfering MFSK 
signal. We study cases of coherent and non-coherent detection for 2FSK, 4FSK, and 
8FSK assuming that the fading channel affects only the desirable MFSK signal and not 
the interfering one. Two separate cases of channel fading are examined: the frequency- 
nonselective, slowly fading Rayleigh channel and the frequency-nonselective, slowly 
fading Rician channel. 

A. RAYLEIGH FADING CHANNEL - COHERENT DETECTION 

In this section, we derive the probability of symbol error for MFSK signals 
transmitted over a frequency-nonselective, slowly fading Rayleigh channel in the 
presence of AWGN and co-channel interference. The frequency-nonselective, slowly 
fading channel results in multiplicative distortion of the MFSK signal. The condition that 
the channel fades slowly implies that the multiplicative process may be considered as a 
constant during at least one symbol interval. Furthermore, we assume that the channel 
fading is sufficiently slow such that the phase shift introduced by the channel can be 
estimated from the received signal without error. 
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1. Theoretical Probability Of Symbol Error For Coherent Detection 

The probability that an MFSK symbol will be received correctly is equal to the 
probability that; 

• case: the signal and the interference symbols are the same and that the noise in any 
of the remaining M-1 branches does not exceed the sum of signal and interference 
symbols, and 

• 2"'* case: the signal and the interference symbols are different and neither the sum of 
the interference and noise nor the noise in any of the remaining M-2 branches exceeds 
the signal. 

a) The Signal And The Interference Symbols Are On The Same 

Branch 

The conditional probability of symbol error for coherent, orthogonal 
MFSK signal when AWGN and co-channel interference is present, is: 


Pl(r)=l 




where; 


J is the amplitude of the interfering MFSK signal and 
r is the amplitude of the desired MFSK signal. 



The symbol error probability is conditioned on the amplitude r of the 
desired signal since the channel is modeled as a Rayleigh fading channel. The amplitude r 
is modeled as Rayleigh random variable with the probability density function: 
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2 

-r 

f(r)=—^-e for r^O and f(r)=0 for r<0 

p . 

sig 

where 

Psig is the average symbol power of the fading MFSK signal. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the information signal’s amplitude r over all possible 
values of r, we obtain the unconditional probability of symbol error for this case: 



Using the transformation 



The double integral in equation (5.5) has to be evaluated numerically. 
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b) The Signal And The Interference Symbols Are On Different 
Branches 

The conditional probability of symbol error for this case has already been 
obtained in equation (4.14). This is given by: 



Integrating the product of the conditional probability of symbol error and the probability 
density function of the information signal’s amplitude r over all possible values of r, we 
get the unconditional probability of symbol error for the second case in the receiver: 



Using again the transformation of (5.4), we obtain 



c) Total Symbol Error Probability 

The total symbol error probability, combining the two cases, is given by: 



where 1/M is the probability that the transmitted and the interfering symbols are on the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are on different branches. 


2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model, which has been developed for the 
simulation of coherent MFSK signaling affected by AWGN and co-channel interference 
in a Rayleigh fading channel, is shown in Figure 67. 
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Figure 67. Model for coherent MFSK with co-channel interference in a Rayleigh fading 
channel. 


This model is a combination of the model that was used for the coherent MFSK 
signal in a Rayleigh fading channel and the model that was used for coherent MFSK 
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signal affected by co-channel interference. These models have already been described in 
Chapter III.A.2 and in [Ref 1]. 


3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of coherent detection of MFSK in a Rayleigh fading channel corrupted by AWGN and 
co-channel interference (“jamming”). Each simulation ran until at least 100 errors were 
observed. The data sequences were limited to 10^ symbols for each simulation in order to 
prevent “out of memory” errors. The data sequence was repeated until a sufficient 
number of errors were counted. 

a) Results For 2FSK 
Using the relationships 


SNR 


ave 


Slg 


noise 


= 10 


10 


and 


p 

interference 


SNRgyg-SJR 


2-P 


= 10 


10 


(5.10) 


noise 


noise 


we can express the symbol error probability in terms of SNR and SIR. Evaluating and 
plotting the theoretical and simulation results versus SNR and SJR, as well as the 
difference (error) between them, we can compare the theory and the simulation. 

The theoretical and the simulation symbol error probabilities for 
coherently detected 2FSK are presented in Figures 68 and 69, respectively, as functions 
of the average signal-to-noise ratio in dB with the signal-to-interference ratio as a 
parameter. The values for SNR and SJR are chosen from -5 dB to +30 dB in increments 
of2.5dB. 
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Figure 68. Theoretical symbol error probability versus SNR with SJR as a parameter 
for coherent 2FSK with Rayleigh fading. 


As is evident from Figure 68 and 69, the curves tend to become flat as 
SNR increases; that is, they converge to a constant value determined by the value of SJR. 
The consequence of signal fading is that the symbol error probability does not decrease as 
fast with the increase in either SNR (along a curve) or SJR (from curve to curve) as it 
does for the case of non-fading signals. 
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Figure 69. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 2FSK with Rayleigh fading. 


In Figure 70 and 71, respectively, the theoretical and simulation results are 
shown as functions of SJR with SNR as a parameter. As the SJR increases, the symbol 
error probability initially decreases, but then tends to a constant value determined by the 
value of the SNR. As the SNR increases, this constant value decreases, but not fast as for 
the case of a non-fading channel. 
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Figure 71. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 2FSK with Rayleigh fading. 


The relative difference (in percent) between the theoretical and simulation 
results is presented in Table 25. In Figure 72, the average difference for each curve is 
plotted versus SNR and SJR for each set of the 15 previously presented curves. 
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Figure 72. Mean percent difference as a function of SNR and SJR, respectively. 

The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

15.488 

2. 

Average Mean Difference (%) 

-2.359 


Maximum Difference (%) 

68.109 

4. 

Minimum Difference (%) 

-42.116 


Difference Deviation (%) 

15.307 


Table 25. Summary of the accuracy of the simulation for coherent 2FSK. 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for 
coherently detected 4FSK are presented in Figures 73 and 74, as functions of the average 
SNR in dB with SIR as a parameter. The values for the signal-to-noise and signal-to- 
interference ratios are between -5 dB and +30 dB, where the lower curve corresponds to 
SJR=+30 dB and the remaining curves are in increments of 2.5 dB. 
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Figure 73. Theoretical symbol error probability versus SNR with SIR as a parameter 
for coherent 4FSK with Rayleigh fading. 
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SEP vs SNR with S JR parameter for 4FSK 


Figure 74. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 4FSK with Rayleigh fading. 


In Figure 75 and 76, respectively, the theoretical and simulation 
probabilities of symbol error are shown as functions of SJR with SNR as a parameter. 
The observation derived from all the graphs is that in order to achieve acceptable values 
for the symbol error probability for a Rayleigh fading channel (lO"^), SNR and SJR must 


be over +30 dB. 
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Figure 75. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK with Rayleigh fading. 


The dramatic increase in the symbol error probability is due to the 
Rayleigh fading channel that allows low values of signal power to occur (following the 
Rayleigh distribution) and thus increase the number of symbol errors. 
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Figure 76. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK with Rayleigh fading. 


The relative difference (in percent) between theoretical and simulation 
results is presented in Table 26. In Figure 77, the average difference for each curve is 
plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 77. Mean percent difference as a function of SNR and SIR. 


The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SIR as parameter) and SIR (with SNR as parameter). 


■ 

SYMBOL ERROR PROBABILITY 

COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

7.078 

2. 

Average Mean Difference (%) 

-0.74 

3. 

Maximum Difference (%) 

45.903 

4. 

Minimum Difference (%) 

-20.812 

5. 

Difference Deviation (%) 

7.039 


Table 26. Summary of the accuracy of the simulation for coherent 4FSK. 
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c) Results For 8FSK 

The theoretical and the simulation symbol error probabilities for 
coherently detected 8FSK are presented in Figures 78 and 79, respectively, as functions 
of the average SNR in dB with SIR as a parameter. The values for the signal-to-noise and 
signal-to-interference ratios are between -5 dB and +30 dB, where the lower curve 
corresponds to SJR=+30 dB and the remaining curves are in increments of 2.5 dB. 
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Figure 78. Theoretical symbol error probability versus SNR with SJR as a parameter 
for coherent 8FSK with Rayleigh fading. 
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Figure 79. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 8FSK with Rayleigh fading. 


In Figures 81 and 82, respectively, the theoretical and simulation symbol 
error probability is shown as a function of SJR with SNR as a parameter. Again we 
observe that in order to achieve acceptable values for the symbol error probability, the 
SNR and SJR must be over +30 dB. 
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Figure 80. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 8FSK with Rayleigh fading. 

The dramatic increase in the symbol error probability is due to the 
Rayleigh fading channel, as it was observed for the cases of 2FSK and 4FSK. 














Figure 81. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 8FSK with Rayleigh fading. 


The relative difference (percent “error”) between the theoretical and the 
simulation results is shown in Table 27. In Figure 82, the average difference for each 
curve is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 82. Mean percent difference as a function of SNR and SJR. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

7.98 

m 

Average Mean Difference (%) 

-1.098 

m 

Maximum Difference (%) 

30.214 

m 

Minimum Difference (%) 

-30.273 

5. 

Difference Deviation (%) 

7.904 


Table 27. Summary of the accuracy of the simulation for coherent 8FSK. 
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Observing the results for coherent detection of 2, 4, and 8FSK in a 
Rayleigh fading channel and affected by AWGN and co-channel interference, we note 
that the simulation overestimates the theory for all of the cases of 2, 4, and 8FSK. The 
root mean square difference (in percent) is about 10% (in average) and the mean percent 
difference for all the cases is less than 10% (in absolute value), which suggests good 
accuracy. 


The average results for the coherent detection of 2, 4, and 8FSK are 
presented in Table 28. 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR COHERENT 

2,4, AND 8FSK 

■ 

Root Mean Square Difference (%) 

10.182 

2. 

Average Mean Difference (%) 

-1.399 

3. 

Maximum Difference (%) 

48.075 

4. 

Minimum Difference (%) 

-31.067 

5. 

Difference Deviation (%) 

10.083 


Table 28. Average results for the coherent detection of 2,4, and 8FSK. 


126 





B. RAYLEIGH FADING CHANNEL - NON-COHERENT DETECTION 


In this section, we derive the symbol error probability for non-coherent detection 
of MFSK signals transmitted over a frequency nonselective, slowly fading Rayleigh 
channel in the presence of AWGN and co-channel interference. 

1. Theoretical Probability Of Symbol Error For Non-Coherent 
Detection 

The probability that the signal symbol will be received correctly is evaluated, 
again, separately for the following two cases: 

• 1®‘ case: the signal and the interference symbols are on the same branch. 

• 2"^ case: the signal and the interference symbols are on different branches. 

Then, combining the two cases, we evaluate the total symbol error probability. 

a) The Signal And The Interference Symbols Are On The Same 
Branch 

The conditional probability of symbol error for non-coherent, orthogonal 
MFSK signal with AWGN and co-channel interference has been already derived in 
Chapter IV (equation (4.30)): 


M- 1 


PI 


error 


(r)= Y. 


(M- 1)! 


k= 1 


kKM- 1 -k)! 


•(- 1 ) 


k+l 


-k-(r-nr 

2-(k-hl)-a^ 


(5.11) 


k+l 


where: 

J is the amplitude of the interfering MFSK signal 
r is the amplitude of the desired MFSK signal 
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The desired signal amplitude r is a Rayleigh random variable with the 


probability density function: 


-r 


f(r)=- 


2P 


sig 


for rSO and f(r)=0 for r<0 


(5.12) 


Slg 


where: 

Psig is the symbol power of the fading desired signal. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the desired signal’s amplitude r over all possible values 
of r, we obtain the unconditional probability of symbol error: 

roo 


Pl = 


M- 1 

E 

k=l 


-k(r+Jr 


(M- 1) ! 


kKM - 1 - k)! 


(- 1 ) 


k+i 1 2-(k+l)P, 

•--e 
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2P 


Slg 


dr 


(5.13) 
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JO 


where Pnoise is the noise power equal to 
Using the transformation: 



(5.14) 


we obtain: 
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The above integral must be evaluated numerically. 


b) The Signal And The Interference Symbols Are On Different 
Branches 

The conditional probability of symbol error for coherent detection of 
orthogonal MFSK signal with AWGN and interference has already been obtained 
(equation (4.43)): 



Integrating the product of the conditional probability of symbol error and the probability 
density function of the desired signal amplitude r over all possible values of r, we get the 
unconditional probability of symbol error for the second case in the receiver: 




Using again the transformation of (5.14) we obtain: 
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The double integral of equation (5.18) has to be evaluated numerically. The summation 
that appears inside the integral has to be limited to a finite number, which sometimes 
causes distortion to the curves that represent the corresponding symbol error probability 
(c.f.. Figures 83, 85, 88, 90, 93 and 95). 

c) Total Symbol Error Probability 

The total symbol error probability, combining the two cases, is given by: 

Pe_coher=—-PI —?--P2 (5.19) 

M M 

where 1/M is the probability that the transmitted and the interfering symbols are at the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are at different branches. 


2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model for the simulation of non-coherent 
MFSK signal affected by AWGN and co-channel interference in a Rayleigh fading 
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channel is the same as the block diagram shown in Figure 64 for coherent detection. The 
only exception is that the block ‘Coh MFSK demod baseband’ has been displaced by the 
block ‘Non-coherent MFSK demod baseband’. 


3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of MFSK with non-coherent detection of the desired signal corrupted by AWGN and co¬ 
channel interference in a Rayleigh fading channel. Each simulation ran until at least 100 
errors were observed. The data sequences were limited to 10^ symbols for each 
simulation to prevent ‘out of memory’ errors and the simulation sequence was repeated 
until a sufficient number of errors were counted, 
a) Results For 2FSK 

Using the relationships 



SNRaYg-SJR 



(5.20) 


we can express the theoretical symbol error probability in terms of SNR and SIR. The 
values for the SNR and SIR have been chosen from -5 dB to +16 dB in increments of 1.5 
dB. 
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Figure 83. Theoretical symbol error probability versus SNR with SIR as a 
for non-coherent 2FSK with Rayleigh fading. 


















Figure 84. Simulation symbol error probability versus SNR with S JR as a parameter 
for non-coherent 2FSK with Rayleigh fading. 

In Figure 85 and 86, respectively, the theoretical and simulation symbol 
error probabilities are shown as functions of SIR with SNR as a parameter. 
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Figure 85. Theoretical symbol error probability versus SIR with SNR as a parameter 
for non-coherent 2FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 
Rayleigh fading and co-channel interference. Furthermore, non-coherent detection also 
increases the number of errors in the receiver as compared to the coherent detection. 
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Figure 86. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 2FSK with Rayleigh fading. 


The relative difference (percent “error”) between the theory and the 
simulation is summarized in Table 29. In Figure 87, the average difference is plotted 
versus SNR and SJR, respectively, for each of the 15 previously presented curves. 


135 







































1 , Aco Mean _Percent Error vs SNR and SJR 

ji.uoij 15 


10 


m 

□BE 
E2^ 0 

OQO 

-5 

-10 

.-11.352 

-15 

-5 0 5 10 15 

-5 SNR ,SJR 16 

m n 

Figure 87. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

11.852 

2. 

Average Mean Difference (%) 

-0.376 

3. 

Maximum Difference (%) 

37.275 

m 

Minimum Difference (%) 

-93.245 

5. 

Difference Deviation (%) 

11.846 


Table 29. Summary of the accuracy of the simulation for non-coherent 2FSK. 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 4FSK are presented in Figures 88 and 89, respectively, as functions 
of the average SNR in dB, with SIR as a parameter. The values for the signal-to-noise 
and signal-to-interference ratios have been chosen from —5 dB to +16 dB, where the 
lower curve corresponds to SJR=+16 dB and the remaining curves are in increments of 
1.5 dB. 
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Figure 88. Theoretical symbol error probability versus SNR with SJR as a parameter 

for non-coherent 4FSK with Rayleigh fading. 
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Figure 89. Experimental symbol error probability versus SNR with SJR as a parameter 
for non-coherent 4FSK with Rayleigh fading. 


In Figures 90 and 91, respectively, the theoretical and simulation symbol 


error probabilities are shown as functions of SJR with SNR as a parameter. 
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Figure 90. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 
Rayleigh fading and co-channel interference. 
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Figure 91. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK with Rayleigh fading. 


In Figure 92, the average difference for each curve is plotted versus SNR 
and SJR for each of the 15 previously presented curves. Finally, the relative difference 
(percent “error”) between the theory and the simulation is summarized in Table 30. 
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Figure 92. Mean percent difference as a function of SNR and SIR. 


The two curves show how the mean difference varies with SNR and SIR. 
Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 


(with SIR as parameter) and SIR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

13.913 

2. 

Average Mean Difference (%) 

4.67 


Maximum Difference (%) 

24.316 

4. 

Minimum Difference (%) 

-170.45 

5. 

Difference Deviation (%) 

13.105 


Table 30. Summary of the accuracy of the simulation for non-coherent 4FSK. 
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c) Results For 8FSK 


The theoretical and the simulation symbol error probabilities for non- 
coherently detected 8FSK are presented in the Figures 93 and 94, respectively, as 
functions of the average SNR in dB, with SIR as a parameter. The values for the signal- 
to-noise and signal-to-inteiference ratios have been chosen from -5 dB to +16 dB in 
increments of 1.5 dB. 



Figure 93. Theoretical symbol error probability versus SNR with SIR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 


142 





























sin 


SEP vs SNR with SJR parameter for 8FSK 
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Figure 94. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 

In Figures 95 and 96, respectively, the theoretical and simulation symbol 
error probabilities are shown as functions of SJR with SNR as a parameter. 
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Figure 95. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 
Rayleigh fading and co-channel interference. 
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Figure 96. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 


In Figure 97, the average difference for each curve is plotted versus SNR 
and SJR for each of the 15 previously presented curves. Finally, the relative difference 
(percent “error”) between the theory and the simulation is summarized in Table 31. 


145 











































Figure 97. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SIR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

14.029 

2. 

Average Mean Difference (%) 

4.836 

3. 

Maximum Difference (%) 

24.288 

m 

Minimum Difference (%) 

-161.825 

5. 

Difference Deviation (%) 

13.17 


Table 31. Summary of the accuracy of the simulation for non-coherent 8FSK. 
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Observing the results for non-coherent detection of 2, 4, and 8FSK in a 
Rayleigh fading channel and affected by AWGN and co-channel interference, we note 
that the simulation overestimates the theory for the case of 2FSK and underestimates the 
theory for the cases of 4 and 8FSK. The root mean square difference (in percent) is about 
13% (in average) and the mean percent difference for all the cases is less than 5% (in 
absolute value), which suggests good accuracy. 


The average results for the non-coherent detection of 2, 4, and 8FSK are 
presented in Table 32. 


■ 

SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR NON¬ 
COHERENT 2,4, AND 8FSK 

■ 

Root Mean Square Difference (%) 

13.264 


Average Mean Difference (%) 

3.043 

3. 

Maximum Difference (%) 

28.626 

1 

Minimum Difference (%) 

-141.84 


Difference Deviation (%) 

12.707 


Table 32. Average results for the non-coherent detection of 2,4, and 8FSK. 
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c. 


RICIAN FADING CHANNEL - COHERENT DETECTION 


In this section, we derive the symbol error probability for MFSK signals 
transmitted over a frequency-nonselective, slowly fading Rician channel in the presence 
of AWGN and co-channel interference. The frequency-nonselective, slowly fading 
channel results in multiplicative distortion of the MFSK transmitted signal. The condition 
that the channel fades slowly implies that the multiplicative process may be considered as 
a constant during at least one symbol interval. Furthermore, we assume that the channel 
fading is sufficiently slow such that the phase shift introduced by the channel can be 
estimated from the received signal without error. 


1. Theoretical Probability Of Symbol Error For Coherent Detection 

The probability that the signal sjnmbol will be received correctly is evaluated, 
again, separately for the two following cases: 

• Case 1: the signal and the interference symbols are on the same branch of the receiver 

• Case 2: the signal and the interference symbols are at different branches. 

a) The Signal And The Interference Symbols Are On The Same 
Branch 

The conditional probability of symbol error for coherent orthogonal 
MFSK with AWGN and co-channel interference has been derived in (4.7) of Chapter 
IV.B.1: 
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Pl(r)=l 
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where: 


J is the amplitude of the interfering MFSK signal and 
r is the amplitude of the desired MFSK signal. 

The above symbol error probability is conditioned on the amplitude r of 
the desired signal, which can be considered as a Rician random variable with the 
probability density function: 


f(r)=- 


■\r j 

•10 


2Pdif 


2-P 


dir'*^ 


(5.22) 


dif 


\ ’’dif / 


where: 

Pdir is the power of the direct signal component 
Pdif is the power of the diffuse signal component. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the information signal’s amplitude r over all possible 
values of r, we obtain the unconditional probability of symbol error for this first case: 
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Using the transformation: 




:=y 




(5.24) 
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we obtain: 



The above double integral has to be evaluated numerically. 


b) The Signal And The Interference Symbols Are On Different 
Branches 

The conditional probability of symbol error for this case has been derived 
in (4.14) of Chapter IV.B. 1: 





jM-2 


1-Q 



2 

-X 

•e ^ dx 


(5.26) 


Integrating the product of the conditional probability of symbol error and the probability 
density function of the desired signal’s amplitude r over all possible values of r, we get 
the unconditional probability of symbol error: 



Using again the transformation of equation (5.24), we obtain: 
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The above integral must be evaluated numerically. 

c) Total Symbol Error Probability 

The total symbol error probability, combining the two cases, is given by: 


P 


totaT 



+ 


M- 1 
M 


•P2 


(5.29) 


where 1/M is the probability that the desired and the interfering symbols are at the same 
branch and (M-l)/M is the probability that the desired and the interfering symbols are at 
different branches. 

It is convenient to define the ratio of the powers of direct and diffuse components as: 


R= 


P 

P 


dir 

dif 


(5.30) 


For a given value of total signal power, we have: 

Power dir + Power dif= Power signal_total (5-31) 

Next, we will express the last relationship in terms of the ratio of the two powers of direct 
and diffuse components as: 


Power signal_total^ 1 + R 

Power dif 


(5.32) 


151 





Now, we are able to evaluate and plot the theoretical symbol error probability as a 
function of the ratio of the powers of the direct and diffuse signal components. 
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2. Simulink Model and Block Analysis 

The block diagram of the Simulink model for coherent MFSK with AWGN and 
co-channel interference in a Rician fading channel is shown on Figure 98. This model is a 
combination of the model that was used for coherent MFSK in a Rician fading channel 
and the model that was used for coherent MFSK signal with co-channel interference. 



Figure 98. Model for coherent MFSK with AWGN and co-channel interference in 
a Rician fading channel. 


3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of coherent detection of MFSK corrupted by AWGN and co-channel interference in a 
Rician fading channel. Each simulation ran until at least 100 errors were observed. The 
data sequences were limited to 10^ symbols for each simulation in order to prevent “out 
of memory” errors. The simulation sequence was repeated until a sufficient number of 
errors were counted. 
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a) Results For 2FSK 


The theoretical and the simulation symbol error probabilities for 
coherently detected 2FSK are presented in the Figures 99 and 100, respectively, as 
functions of the average SNR in dB, with SIR as a parameter. The values for the signal- 
to-noise and signal-to-interference ratios were chosen from -5 dB to +30 dB in 
increments of 2.5 dB. 



“5 0 5 10 15 20 25 30 


Figure 99. Theoretical symbol error probability versus SNR with SIR as a parameter 


for coherent 2FSK, with Rician fading and R=l. 
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Figure 100. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 2FSK with Rician fading and R=l. 


In Figure 101 and 102, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 


parameter. 
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Figure 102. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 2FSK, with Rician fading and R=l. 


To avoid any by chance distortion on the curves of the simulation results, 
we have to ran the same pattern many times and average the results. The relative 
difference (percent “error”) between the theory and the simulation is presented in Table 
33. In Figure 103, the average difference for each curve is plotted versus SNR and SJR 
for each of the 15 previously presented curves. 


157 


































Figure 103. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 
Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 


(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

24.529 

2. 

Average Mean Difference (%) 

15.583 

3. 

Maximum Difference (%) 

68.105 

11 

Minimum Difference (%) 

-26.173 

5. 

Difference Deviation (%) 

18.943 


Table 33. Summary of the accuracy of the simulation for coherent 2FSK. 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for 
coherently detected 4FSK are presented in the Figures 104 and 105, respectively, as 
functions of the average SNR in dB, with SIR as a parameter. The values for the signal- 
to-noise and signal-to-interference ratios were chosen from —5 dB to +30 dB in 
increments of 2.5 dB. 
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Figure 104. Theoretical symbol error probability versus SNR with SJR as a parameter 


for coherent 4FSK, with Rician fading and R=l. 
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Figure 105. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 4FSK, with Rician fading and R=l. 

In Figure 106 and 107, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 


parameter. 
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Figure 106. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK, with Rician fading and R=l. 


We note again the dramatic increase in the S)nnbol error probability due to 
Rician fading and co-channel interference. 
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Figure 107. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK, with Rician fading and R=l. 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 34. In Figure 108, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 


162 






























Mean Percent Error vs SJR and SNR 



Figure 108. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

28.765 

2. 

Average Mean Difference {%) 

18.161 

3. 

Maximum Difference {%) 

60.64 

m 

Minimum Difference (%) 

-17.322 

5. 

Difference Deviation (%) 

22.307 


Table 34. Summary of the accuracy of the simulation for coherent 4FSK. 
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c) Results For 8FSK 


The theoretical and the simulation s 5 mibol error probabilities for 
coherently detected 8FSK are presented in the Figures 109 and 110, respectively, as 
functions of the average SNR in dB with SIR as a parameter. The values for the signal- 
to-noise and signal-to-interference ratios were chosen from -5 dB to +30 dB in 
increments of 2.5 dB. 



SEP vs SNR with SJR parameter for 8FSK 
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Figure 109. Theoretical symbol error probability versus SNR with SJR as a parameter, 
for coherent 8FSK, with Rician fading and R=l. 
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Figure 110. Simulation symbol error probability versus SNR with SIR as parameter 
for coherent 8FSK, with Rician fading and R=l. 


In Figures 111 and 112, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SIR with SNR as a 
parameter. 
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Figure 111. Theoretical symbol error probability versus S JR with SNR as a parameter 
for coherent 8FSK, with Rician fading and R=l. 

We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 
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Figure 112. Simulation symbol error probability versus SJR with SNR as parameter 
for coherent 8FSK, with Rician fading and R=l. 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 35. In Figure 113, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 113. Mean percent difference as a function of SNR and SIR, respectively. 

The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SIR as parameter) and SIR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILirY 

COHERENT 8FSK 

I. 

Root Mean Square Difference (%) 

28.276 

2. 

Average Mean Difference (%) 

21.138 

3. 

Maximum Difference (%) 

60.009 

m 

Minimum Difference (%) 

-9.858 

5. 

Difference Deviation (%) 

18.781 


Table 35. Summary of the accuracy of the simulation for coherent 8FSK. 
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Observing the results for coherent detection of 2, 4, and 8FSK in a Rician 
fading channel and affected by AWGN and co-channel interference, we note that the 
simulation underestimates the theory for all of the cases of 2,4 and 8FSK. The root mean 
square difference (in percent) is about 27% (in average) and the mean percent difference 
for all the cases is about 18%. 


The average results for the coherent detection of 2, 4, and 8FSK are 
presented in Table 36. 


■ 

SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR COHERENT 

2,4, AND 8FSK 

1. 

Root Mean Square Difference (%) 

27.19 

2. 

Average Mean Difference (%) 

18.294 

3. 

Maximum Difference (%) 

62.918 

■ 

Minimum Difference (%) 

-17.784 


Difference Deviation (%) 

20.01 


Table 36. Average results for the coherent detection of 2,4, and 8FSK. 
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D. RICIAN FADING CHANNEL - NON-COHERENT DETECTION 

In this section, we derive the symbol error probability for non-coherent detection 
of MFSK signals transmitted over a frequency-nonselective, slowly fading Rician 
channel with AWGN and co-channel interference. 


1. Theoretical Probability Of Symbol Error For Coherent Detection 

The probability that the signal symbol will be received correctly is evaluated, 
again, separately for the two cases: 

• case: the signal and the interference symbols are on the same branch. 

• 2“** case: the signal and the interference symbols are on different branches. 

Then, combining the two cases, we evaluate the total symbol error probability, 
a) The Signal And The Interference Symbols Are On The Same 
Branch 

The conditional probability of symbol error for non-coherent, orthogonal 
MFSK with AWGN and co-channel interference has already been derived in (4.30) of 
Chapter IV.C: 


M- 1 


-k(r+jr 


Pl(r)= ^ 


(M- 1)! 


k= 1 


k!-(M- 1 -k)! 


(-1) 


k+l 1 2-(k-i-l)-a 

k+ 1 


(5.37) 


where: 

J is the amplitude of the interfering MFSK signal and 
r is the amplitude of the desired MFSK signal. 
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The above symbol error probability is conditioned on the amplitude r of 
the desired signal since the channel is modeled as a Rician fading channel. The amplitude 
r is a Rician random variable with the probability density function: 


T + 2-P 


dir 
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2-Pdif 
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dif 


dif 


(5.38) 


where: 

Pdir is the power of the direct signal component 
Pdif is the power of the diffuse signal component. 

Integrating the product of the conditional probability and the probability 
density function of the desired signal’s amplitude r over all possible values of r, we obtain 
the unconditional probability of symbol error for this case: 


Pl= 


M- 1 

z 

k=l 


-k-(r-t-jr 




(M-1) ! ivk - l -1 1 2-(k+l)-P„Qj5g r 2-Pdif 

--(-I) '--e ---e -lUI 


kKM- 1-k)! 


k-i-1 


Pdif 


2'Pdif*^ 


I Pdif / 


dr 


(5.39) 


Using the transformation: 




(5.40) 


we obtain (see also the closed form solution in Appendix 2): 
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The last integral must be evaluated numerically. 

b) The Signal And The Interference Symbols Are At Different 
Branches 

The conditional probability of symbol error for this case has already been 
derived in (4.43) of Chapter IV.C: 



Integrating the product of the conditional probability of symbol error and the probability 
density function of the desired signal’s amplitude r over all possible values of r, we get 
the unconditional probability of symbol error which, applying the transformation of 
(5.40), is given by: 



The integral above must be evaluated numerically. 

c) Total Symbol Error Probability 

The total symbol error probability, combining the two cases is given by: 


(5-44) 

M M 
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where 1/M is the probability that the transmitted and the interfering symbols are at the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are at different branches. 

Substituting equation (5.30) and (5.34) into the equation (5.41) and (5.43), 
we get for the symbol error probability the following expressions: 





The above integrals have to be evaluated numerically. 
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2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model, which has been developed for the 
simulation of non-coherent MFSK with AWGN and co-channel interference in a Rician 
fading channel, is the same as the block diagram shown in Figure 95 for coherent 
detection except that the block ‘Coh MFSK demod baseband’ has been replaced by the 
block ‘Non-coherent MFSK demod baseband’. 

3. Simulation Analysis And Performance Veriflcation 

In this section, simulation results are presented in order to verify the performance 
of non-coherent detection of MFSK corrupted by AWGN and co-channel interference in 
a Rician fading channel. Each simulation ran until at least 100 errors were observed. The 
data sequences were limited to 10^ symbols for each simulation in order to prevent “out 
of memory” errors. The simulation sequence was repeated until a sufficient number of 
errors were counted. 

a) Results For 2FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 2FSK are presented in Figures 114 and 115, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from -5 dB to +16 dB in increments 
of 1.5dB. 
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Figure 114. Theoretical symbol error probability versus SNR with SJR as a parameter 


for non-coherent 2FSK, with Rician fading and R=l. 


As evident from Figure 114 and 115, the curves tend to become flat as 
SNR increases; that is, they converge to a constant value determined by the value of SJR. 
The consequence of the signal fading is that the symbol error probability does not 
decrease as fast with the increase in either SNR (along a curve) or SJR (from curve to 
curve) as it does for the case of non-fading signals. 
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Figure 115. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 2FSK, with Rician fading and R=l. 


In Figures 116 and 117, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 
parameter. 
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Figure 116. Theoretical symbol error probability versus SJR with SNR as a parameter 


for non-coherent 2FSK, with Rician fading and R=l. 


We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 
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Figure 117. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 2FSK, with Rician fading and R=l. 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 37. In Figure 118, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 118. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

-———-_ 

19.441 

m 

Average Mean Difference (%) 

2.461 

a 

Maximum Difference (%) 

39.575 

m 

Minimum Difference (%) 

-45.235 

5. 

Difference Deviation (%) 

19.285 


Table 37. Summary of the accuracy of the simulation for non-coherent 2FSK. 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 4FSK are presented in the Figures 119 and 120, respectively, as 
functions of average SNR in dB with SIR as parameter. The values for the signal-to-noise 
and signal-to-interference ratios were chosen from -5 dB to +16 dB in increments of 1.5 
dB. 
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Figure 119. Theoretical symbol error probability versus SNR with SIR as a parameter 
for non-coherent 4FSK, with Rician fading and R=l. 
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Figure 120. Simulation symbol error probability versus SNR with SJR as parameter 
for non-coherent 4FSK, with Rician fading and R=l. 


In Figures 121 and 122, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 
parameter. 
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Figure 121. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK, with Rician fading and R=l. 


We note again the dramatic increase in the symbol error probability due to 


Rician fading and co-channel interference. 
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Figure 122. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK, with Rician fading and R=l. 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 38. In Figure 123, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 123. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SIR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

25.018 

2. 

Average Mean Difference (%) 

17.252 

3. 

Maximum Difference (%) 

52.157 

4. 

Minimum Difference (%) 

-119.047 

5. 

Difference Deviation (%) 

18.119 


Table 38. Summary of the accuracy of the simulation for non-coherent 4FSK. 
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c) Results For 8FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 8FSK are presented in the Figures 124 and 125, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from -5 dB to +16 dB in increments 
of 1.5dB. 
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Figure 124. Theoretical symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK, with Rician fading and R=L 
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Figure 125. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK, with Rician fading and R=l. 


In Figures 126 and 127, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 
parameter. 
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Figure 126. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK, with Rician fading and R=l. 

We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 
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Figure 127. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK, with Rician fading and R=l. 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 39. In Figure 128, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Mean Percent Error vs SJR and SNR 
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Figure 128. Mean percent difference as a function of SNR and SJR, respectively. 

The two curves show how the mean difference varies with SNR and SJR. 
Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 

SYMBOL ERROR PROBABILITY I NON-COHERENT 8FSK 

1. Root Mean Square Difference (%) 14.848 

2. Average Mean Difference (%) 10.402 

3. Maximum Difference (%) 30.315 

4. Minimum Difference (%) -108.758 

5. Difference Deviation (%) 10.596 

Table 39. Summary of the accuracy of the simulation for non-coherent 8FSK. 
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Observing the results for non-coherent detection of 2, 4, and 8FSK in a 
Rician fading channel and affected by AWGN and co-channel interference, we note that 
the simulation underestimates the theory for all of the cases of 2, 4, and 8FSK. The root 
mean square difference (in percent) is about 27% (in average) and the mean percent 
difference for all the cases is about 18%. 


The average results for the non-coherent detection of 2, 4, and 8FSK are 
presented in Table 40. 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR NON¬ 
COHERENT 2,4, AND 8FSK 

1. 

Root Mean Square Difference (%) 

19.769 

2. 

Average Mean Difference (%) 

10.038 


Maximum Difference (%) 

40.682 

4. 

Minimum Difference (%) 

-91.013 

5. 

Difference Deviation (%) 

16 


Table 40. Average results for the non-coherent detection of 2, 4, and 8FSK. 
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VI. MFSK SIGNAL CORRUPTED BY AWGN AND CO-CHANNEL 


INTERFERENCE IN A FADING CHANNEL THAT AFFECTS BOTH 
THE DESIRED AND THE INTERFERING SIGNAL 
In this chapter we derive the theoretical symbol error probability for MFSK with 
AWGN and co-channel interference and operating in a fading channel. The co-channel 
interference is represented by another MFSK signal added to the desired MFSK signal. 
We study cases of both coherent and non-coherent detection for 2FSK, 4FSK, and 8FSK 
and assume that the fading channel affects both the desirable MFSK signal and the 
interfering one. Two separate cases of channel fading are examined; a frequency- 
nonselective, slowly fading Rayleigh channel and a frequency-nonselective, slowly 
fading Rician channel. 

A. RAYLEIGH FADING CHANNEL - COHERENT DETECTION 

In this section, we derive the symbol error rate for MFSK signals transmitted over 
a frequency-nonselective, slowly fading Rayleigh channel in the presence of AWGN and 
co-channel interference. The frequency-nonselective, slowly fading channel results in 
multiplicative distortion of the MFSK transmitted signal and also of the MFSK 
interfering signal. The condition that the channel fades slowly implies that the 
multiplicative process may be considered as a constant during at least one symbol time 
interval. Furthermore, we assume that the channel fading is sufficiently slow such that the 
phase shift introduced by the channel can be estimated from the received signal without 
error. 
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1. Theoretical Probability Of Symbol Error For Coherent Detection 

The probability that the signal symbol will be received correctly is equal to the 
probability that: 

• 1** case: the signal and the interference symbols are on the same branch and that the 
noise in any of the remaining M-1 branches does not exceed the sum of signal and 
interference symbols, and 

• 2"^ case: the signal and the interference symbols are on different branches and neither 
the sum of the interference and noise nor the noise in any of the remaining M-2 
branches exceeds the signal. 

a) The Signal And The Interference Symbols Are On The Same 

Branch 

The conditional probability of symbol error for coherent, orthogonal 
MFSK Rayleigh fading signal when AWGN and co-channel interference are present has 
been determined in the preceding Chapter V.A, equation (5.5): 
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where: 

rj is the amplitude of the interfering MFSK signal. 

This symbol error probability is conditioned on the amplitude q of the 
interfering signal, since the interfering signal is affected by the Rayleigh fading channel. 
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The amplitude rj of the interfering signal is a Rayleigh random variable with the 
probability density function: 




J’ jam; p. 


where Pjam is the symbol power of the fading interfering signal. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the interfering signal’s amplitude rj over all possible 
values of rj, we obtain the unconditional probability of symbol error for this case: 
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Using the transformation: 


we obtain: 
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This triple integral has to be evaluated numerically. 
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b) The Signal And The Interference Symbols Are On Different 
Branches 

The conditional probability of symbol error for this case has already been 
obtained in equation (5.8) of Chapter V.A: 



Integrating the product of the conditional probability of symbol error and the probability 
density function of the interfering signal’s amplitude q over all possible values of q, we 
get the unconditional probability of symbol error: 



Using the transformation of (6.4), we obtain: 



The above integral must be evaluated numerically. 
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c) Total Symbol Error Probability 

The total symbol error probability, obtained by combining the two cases, 

is given by: 


where 1/M is the probability that the transmitted and the interfering symbols are on the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are on different branches. 

2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model, developed for the simulation of 
coherent MFSK with AWGN and co-channel interference in a Rayleigh fading channel, 
is shown in Figure 129. 
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Figure 129. Model for coherent MFSK with co-channel interference in a Rayleigh fading 


channel. 















This model is the combination of the model that was used for the coherent MFSK 
signal in a Rayleigh fading channel and the model that was used for coherent MFSK 
signal affected by co-channel interference. Note that the desired MFSK signal and the 
interfering one fade independently. 


3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of coherent MFSK system with AWGN and co-channel interference in a Rayleigh fading 
channel. Each simulation ran until at least 100 errors were observed. The data sequences 
were limited to 10® symbols for each simulation in order to prevent “out of memory” 
errors. The data sequence was repeated until a sufficient number of errors were counted, 
a) Results For 2FSK 
Using the relationships 

SNR SNR- SIR 

^= 10 “ ^=10 “ 

P • P . 

noise ^ noise 


( 6 . 10 ) 


we can express the symbol error probability in terms of SNR and SIR. Evaluating and 
plotting the theoretical and simulation results versus SNR and SIR, as well as the 
difference (error) between them, we can compare the theory and the simulation. 

The theoretical and the simulation symbol error probabilities for 
coherently detected 2FSK are presented in Figures 130 and 131, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for the signal-to- 
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noise and signal-to-interference ratios are chosen from —5 dB to +30 dB in increments of 
2.5 dB. 
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Figure 130. Theoretical symbol error probability versus SNR with SJR as a parameter 
for coherent 2FSK with Rayleigh fading. 


As evident from Figures 129 and 130, the curves tend to become flat as 
the SNR increases; that is, they converge to a constant value determined by the value of 
the SJR. The consequence of signal fading is that the symbol error probability does not 
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decrease as rapidly with the increase in either SNR (along a curve) or SIR (from curve to 
curve) as it does for cases of non-fading signals. 
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Figure 131. Simulation symbol error probability versus SNR with SIR as a parameter 
for coherent 2FSK with Rayleigh fading. 


In Figures 132 and 133, respectively, the theoretical and simulation results 
are shown as functions of SIR with SNR as a parameter. As SIR increases, the symbol 
error probability initially decreases but then tends to a constant value determined by the 
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value of the SNR. As the SNR increases this constant value decreases but not rapidly as 
for the case of a non-fading channel. 
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Figure 132. Theoretical symbol error probability versus SIR with SNR as a parameter 
for coherent 2FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 


Rayleigh fading and co-channel interference. 


199 























































SEP vs SJR with SNR parameter for 2FSK 
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Figure 133. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 2FSK with Rayleigh fading. 


The relative difference (in percent) between the theoretical and simulation 
results is presented in Table 41. In Figure 134, the average difference for each curve is 
plotted versus SNR and SJR for each set of the 15 previously presented curves. 
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Figure 134. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

10.524 

2. 

Average Mean Difference (%) 

-1.52 

3. 

Maximum Difference (%) 

34.107 

B 

Minimum Difference (%) 

-19.562 

5. 

Difference Deviation (%) 

10.414 


Table 41. Summary of the accuracy of the simulation for coherent 2FSK. 
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b) Results For 4FSK 


The theoretical and the simulation symbol error probabilities for 
coherently detected 4FSK are presented in Figures 135 and 136, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for SNR and SIR 
are between -5 dB and +30 dB in increments of 2.5 dB. 
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Figure 135. Theoretical symbol error probability versus SNR with SIR as a parameter 
for coherent 4FSK with Rayleigh fading. 
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Figure 136. Simulation symbol error probability versus signal-to-noise ratio (SNR), 
with the signal-to-interference ratio (SJR) as parameter, for coherent 4FSK. 


In Figures 137 and 138, respectively, the theoretical and simulation 
probabilities of symbol error are shown as functions of SJR with SNR as a parameter. 
The observation derived from all the graphs is that in order to achieve acceptable values 
for the symbol error probability (lO"^) for a Rayleigh fading channel, SNR and SJR must 
both be over +30 dB. 
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Figure 137. Theoretical symbol error probability versus SIR with SNR as a parameter 
for coherent 4FSK with Rayleigh fading. 


The dramatic increase in the symbol error probability is due to the 
Rayleigh fading channel that allows low values of signal power to occur (following the 
Rayleigh distribution) and this case increase in the number of symbol errors. 
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Figure 138. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK with Rayleigh fading. 


The relative difference (percent “error”) between the theoretical and 
simulation results is presented in Table 42. In Figure 139, the average difference for each 
curve is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 139. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SIR as parameter) and SIR (with SNR as parameter). 



SYMBOL ERROR PROBABILirY 

COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

9.02 


Average Mean Difference (%) 

3311 

3. 

Maximum Difference (%) 

24.071 

11 

Minimum Difference (%) 

-18.58 

5. 

Difference Deviation (%) 

8.384 


Table 42. Summary of the accuracy of the simulation for coherent 4FSK. 
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c) Results For 8FSK 

The theoretical and the simulation symbol error probabilities for 
coherently detected 8FSK are presented in Figures 140 and 141, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for SNR and SIR 
are between -5 dB and +30 dB in increments of 2.5 dB. 
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Figure 140. Theoretical symbol error probability versus SNR with SIR as a parameter 
for coherent 8FSK with Rayleigh fading. 
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Figure 141. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 8FSK with Rayleigh fading. 


In Figures 142 and 143, respectively, the theoretical and simulation 
symbol error probabilities are shown as functions of SJR with SNR as a parameter. Again 
we observe that in order to achieve acceptable values for the symbol error probability, 
SNR and SJR must both be over +30 dB. 
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Figure 142. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 8FSK with Rayleigh fading. 


The dramatic increase in the symbol error probability is due to the 


Rayleigh fading channel, as was observed for the cases of 2FSK and 4FSK. 
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Figure 143. Simulation symbol error probability versus SIR with SNR as a parameter 
for coherent 8FSK with Rayleigh fading. 


The relative difference (percent “error”) between the theoretical and the 
simulation results is shown in Table 43. In Figure 144, the average difference for each 
curve is plotted versus SNR and SIR for each of the 15 previously presented curves. 
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Figure 144. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABJLrTY 

COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

9.446 

2. 

Average Mean Difference (%) 

-1.851 

3. 

Maximum Difference (%) 

19.206 

4. 

Minimum Difference (%) 

-30.409 

5. 

Difference Deviation (%) 

9.263 


Table 43. Summary of the accuracy of the simulation for coherent 8FSK. 
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Observing the results for coherent detection of 2, 4, and 8FSK with 
AWGN and co-channel interference in a Rayleigh fading channel, we note that the 
simulation overestimates the theory for the cases of 2 and 8FSK and underestimates the 
theory for the cases of 4FSK. The root mean square difference (in percent) is about 10% 
(in average) and the mean percent difference for all the cases is much less than 10% 
(about -0.015%), which suggests good accuracy. 


The average results for the coherent detection of 2, 4, and 8FSK are 
presented in Table 44. 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR COHERENT 

2,4, AND 8FSK 

1. 

Root Mean Square Difference (%) 

9.663 

2. 

Average Mean Difference (%) 

-0.015 

3. 

Maximum Difference (%) 

25.795 

H 

Minimum Difference (%) 

-22.85 

5. 

Difference Deviation (%) 

9.354 


Table 44. Average results for the coherent detection of 2,4, and 8FSK. 








B. RAYLEIGH FADING CHANNEL - NON-COHERENT DETECTION 


In this section, we derive the symbol error probability for non-coherent MFSK 
transmitted over a frequency-nonselective, slowly fading Rayleigh channel in the 
presence of AWGN and co-channel interference. 


1. Theoretical Probability Of Symbol Error For Coherent Detection 

The probability that the desired symbol will be received correctly is evaluated 
separately for the following two cases: 

• 1®‘ case: the signal and the interference symbols are on the same branch. 

• 2“^ case: the signal and the interference symbols are on different branches. 

a) The Signal And The Interference Symbols Are On The Same 
Branch 

The conditional probability of symbol error for non-coherent, orthogonal 
MFSK Rayleigh fading signal with AWGN and co-channel interference has been already 
derived in Chapter V (equation (5.15)): 


Pl(rj)= 
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where: 

rj is the amplitude of the interfering MFSK signal. 
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The above symbol error probability is conditioned on the amplitude rj of 
the interfering signal since the channel is modeled as a Rayleigh fading channel. The 
amplitude rj of the interference is modeled as Rayleigh random variable with the 
probability density function: 
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ffr-p- 

jam 


( 6 . 12 ) 


where Pjam is the symbol power of the fading interfering signal. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the interfering signal’s amplitude rj over all possible 
values of rj, we obtain the unconditional probability of symbol error for this case: 
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Using the transformation 



we obtain the following expression which must be evaluated numerically: 


(6.14) 
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b) The Signal And The Interference Symbols Are On Different 
Branches 

The conditional probability of symbol error for this case of non-coherent, 
orthogonal MFSK Rayleigh fading signal with AWGN and interference has been derived 
in Chapter V (equation (5.18)): 



Integrating the product of the conditional probability of symbol error and the probability 
density function of the interfering signal’s amplitude q over all possible values of q, we 
get the unconditional probability of symbol error. Using (6.14) we obtain: 



The triple integral of equation (6.17) has to be evaluated numerically. The summation 
that appears inside the integral has to be limited to a finite number, which sometimes 
causes distortion to the curves that represent the corresponding symbol error probability. 
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c) Total Symbol Error Probability 

The total symbol error probability, obtained by combining the two cases is 

given by: 

„ u 1 T., M - 1 

Pe_ncoh=— P1 +-P2 (6.18) 

M M 

where 1/M is the probability that the transmitted and the interfering symbols are at the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are at different branches. 

2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model which has been developed for the 
simulation of non-coherent MFSK with AWGN and co-channel interference in a 
Rayleigh fading channel, is the same as the block diagram shown in Figure 129 for 
coherent detection, except that the block ‘Coh MFSK demod baseband’ has been 
replaced by the block ‘Non-coherent MFSK demod baseband’. 

3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of MFSK with non-coherent detection of the desired signal corrupted by AWGN and co¬ 
channel interference in a Rayleigh fading channel. Each simulation ran until at least 100 
errors were observed. The data sequences were limited to 10^ symbols for each 
simulation, to prevent “out of memory” errors and the simulation sequence was repeated 
until a sufficient number of errors were counted. 
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a) Results For 2FSK 
Using the relationships 
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we express the theoretical symbol error probability in terms of SNR and SJR. The values 


for the signal-to-noise and signal-to-interference ratios were chosen from -5 dB to +16 


dB in increments of 1.5 dB. 
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Figure 145. Theoretical symbol error probability versus SNR, with SJR as a parameter 


for non-coherent 2FSK with Rayleigh fading. 
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Figure 146. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 2FSK with Rayleigh fading. 

In Figures 147 and 148, respectively, the theoretical and simulation 
symbol error probability are shown as functions of SJR with SNR as a parameter. 









SEP vs SJR with SNR parameter for 2FSK 
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Figure 147. Theoretical symbol error probability versus SJR with SNR as a parameter 


for non-coherent 2FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 
Rayleigh fading and co-channel interference. Furthermore, non-coherent detection also 
increases the number of errors in the receiver as compared to the coherent detection. 
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Figure 148. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 2FSK with Rayleigh fading. 


The relative difference (percent “error”) between the theory and the 
simulation is summarized in Table 45. In Figure 149, the average difference is plotted 
versus SNR and SJR respectively for each of the 15 previously presented curves. 
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Figure 149. Mean percent difference as a function of SNR and SJR, respectively. 

The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

17.385 

2. 

Average Mean Difference (%) 

5.34 

3. 

Maximum Difference (%) 

40.188 

4. 

Minimum Difference (%) 

-123.22 

5. 

Difference Deviation (%) 

16.544 


Table 45. Summary of the accuracy of the simulation for non-coherent 2FSK. 
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b) Results For 4FSK 


The theoretical and the simulation symbol error probabilities for non- 
coherently detected 4FSK are presented in Figures 150 and 151, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for SNR and SIR 
have been chosen from -5 dB to +16 dB in increments of 1.5 dB. 



Figure 150. Theoretical symbol error probability versus SNR with SIR as a parameter 
for non-coherent 4FSK with Rayleigh fading. 
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Figure 151. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 4FSK with Rayleigh fading. 


In Figures 152 and 153, respectively, the theoretical and simulation 
symbol error probabilities are shown as functions of SJR with SNR as a parameter. 
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Figure 152. Theoretical symbol error probability versus SJR with SNR as a parameter 


for non-coherent 4FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 
Rayleigh fading and co-channel interference. 
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Figure 153. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK with Rayleigh fading. 


In Figure 154, the average difference for each curve is plotted versus SNR 
and SJR for each of the 15 previously presented curves. Finally, the relative difference 
(percent “error”) between the theory and the simulation is summarized in Table 46. 
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Figure 154. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SIR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

18.335 

i 

Average Mean Difference (%) 

12.331 

3. 

Maximum Difference (%) 

34.441 

4. 

Minimum Difference (%) 

-92.531 

5. 

Difference Deviation (%) 

13.568 


Table 46. Summary of the accuracy of the simulation for non-coherent 4FSK. 
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c) Results For 8FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 8FSK are presented in the Figures 155 and 156, respectively, as 
functions of average SNR in dB with SJR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios have been chosen from -5 dB to +16 dB in 
increments of 1.5 dB. 
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Figure 155. Theoretical symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 
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Figure 156. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 

In Figures 157 and 158, respectively, the theoretical and simulation 
symbol error probabilities are shown as functions of SJR with SNR as a parameter. 
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Figure 157. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 


We again note the dramatic increase in the symbol error probability due to 


Rayleigh fading and co-channel interference. 
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Figure 158. Experimental symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK with Rayleigh fading. 


In Figure 159, the average difference for each curve is plotted versus SNR 
and SJR for each of the 15 previously presented curves. Finally, the relative difference 
(percent “error”) between the theory and the simulation is summarized in Table 47. 
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Figure 159. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter). 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

13.126 

2. 

Average Mean Difference (%) 

7.145 


Maximum Difference (%) 

35.017 

m 

Minimum Difference (%) 

-78.858 

5. 

Difference Deviation (%) 

11.011 


Table 47. Summary of the accuracy of the simulation for non-coherent 8FSK. 
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Observing the results for non-coherent detection of 2, 4, and 8FSK in a 
Rayleigh fading channel with AWGN and co-channel interference, we note that the 
simulation underestimates the theory for all of the cases of 2, 4 and 8FSK. The root mean 
square difference (in percent) is about 16% (in average) and the mean percent difference 
in average is about 8%, which suggests good accuracy. 


The average results for the non-coherent detection of 2, 4, and 8FSK are 
presented in Table 48. 



SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR NON¬ 
COHERENT 2,4, AND 8FSK 

1. 

Root Mean Square Difference (%) 

16.282 

2. 

Average Mean Difference (%) 

8.272 


Maximum Difference (%) 

36.548 

■ 

Minimum Difference (%) 

-98.203 

5. 

Difference Deviation (%) 

13.708 


Table 48. Average results for the non-coherent detection of 2,4, and 8FSK. 
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C. RICIAN FADING CHANNEL - COHERENT DETECTION 


In this section, we derive the symbol error probability for MFSK signals 
transmitted over a frequency-nonselective, slowly fading Rician channel with AWGN 
and co-channel interference. The frequency-nonselective, slowly fading channel results in 
multiplicative distortion of both the MFSK transmitted signal and the interfering MFSK 
signal. The condition that the channel fades slowly implies that the multiplicative process 
may be considered as a constant during at least one symbol time interval. Furthermore, 
we assume that the channel fading is sufficiently slow that the phase shift introduced by 
the channel can be estimated from the received signal without error. 


1. Theoretical Probability Of Symbol Error For Coherent Detection 

The probability that the signal symbol will be received correctly is evaluated, 
again, separately for the two following cases: 

• 1*‘ case: the signal and the interference symbols are on the same branch. 

• 2“^ case: the signal and the interference symbols are on different branches. 

a) The Signal And The Interference Symbols Are On The Same 
Branch 

The conditional probability of symbol error for coherent, orthogonal 
MFSK Rician fading signal with AWGN and co-channel interference has been derived in 
Chapter V (equation (5.25)): 
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where rj is the amplitude of the interfering MFSK signal. 

The above symbol error probability is conditioned on the amplitude rj of 
the interfering signal, with rj considered as a Rician random variable with the pdf: 


•("/ 


•I-2P: 






j-diry / 
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j_dif 


2-Pj_dir>^j 
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( 6 . 21 ) 


where: 


Pj dir is the power of the direct interfering signal component 
Pj dif is the power of the diffuse interfering signal component. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the interfering signal’s amplitude rj over all possible 
values of rj, we obtain the unconditional probability of symbol error for this case. Using 
the transformation: 


we obtain: 
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This integral has to be evaluated numerically. 
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b) The Signal And The Interference Symbols Are On Different 
Branches 

The conditional probability of symbol error for this case has already been 
derived in Chapter V (equation (5.28)): 



Integrating the product of the conditional probability of symbol error and the probability 
density function of the interfering signal’s amplitude q over all possible values of rj, and 
using the transformation of equation (6.22) we get the unconditional probability of 
symbol error for this case: 



This triple integral has to be evaluated numerically. 


c) Total Symbol Error Probability 



The total s 3 mibol error probability, combining the two cases is given by: 


P 


^ r.. M- 1 
total-- 


(6.26) 


where 1/M is the probability that the desired and the interfering symbols are on the same 
branch and (M-l)/M is the probability that the desired and the interfering symbols are on 
different branches. 

It is convenient to define the ratio of the powers of direct and diffuse 
components of the interfering signal, as: 


- (6.27) 

Pj_dif 

For a given value of total signal power, we have: 

Power j_dir+ Power Power jam_signal_total (6.28) 

Next, we will express the last relationship in terms of the ratio of the powers of direct and 
diffuse components of the interfering signal, as: 


Power;am signal total 

“ “ -=1 + R 


Power 


jam 


(6.29) 


We can easily obtain the relationships: 


^ noise 
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Substituting equations (6.27) and (6.30) into equations (6.23) and (6.25), we are able to 
evaluate and plot the theoretical symbol error probability as a function of the ratio of the 
powers of the direct and diffuse signal components. 


2. Simulink Model and Block Analysis 

The block diagram of the Simulink model, developed for the simulation of 
coherent MFSK with AWGN and co-channel interference in a Rician fading channel, is 
shown on Figure 160. This model is the combination of the model that was used for the 
coherent MFSK in a Rician fading channel and the model that was used for coherent 
MFSK signal affected by co-channel interference. (The block parameters were retained). 



Figure 160. Model for coherent MFSK with AWGN and co-channel interference in a 
Rician fading channel. 
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3. Simulation Analysis And Performance Verification 
In this section, simulation results are presented in order to verify the performance 
of coherent MFSK. 

a) Results For 2FSK 

The theoretical and the simulation symbol error probabilities for 
coherently detected 2FSK are presented in the Figures 161 and 162, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for the SNR and 
SIR were chosen from -5 dB to +30 dB in increments of 2.5 dB. 



“5 0 5 10 15 20 25 30 


Figure 161. Theoretical symbol error probability versus SNR with SJR as a parameter 


238 























for coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 



-5 0 5 10 15 20 25 30 

.-5. SNR^ ^0. 

Figure 162. Simulation symbol error probability versus SNR with SIR as a parameter 
for coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


In Figure 163 and 164, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SIR with SNR Jis a 
parameter. 
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Figure 163. Theoretical symbol error probability versus SIR with SNR as a parameter 


for coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 


240 




















































-5 0 5 10 15 20 25 30 

.-5. SJR„ 30. 


Figure 164. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 49. In Figure 165, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 165. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how, the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SIR as parameter) and SIR (with SNR as parameter), respectively. 


■ 

SYMBOL ERROR PROBABILITY 

COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

13.486 

2. 

Average Mean Difference (%) 

6.962 

3. 

Maximum Difference (%) 

27.207 

4. 

Minimum Difference (%) 

-22.565 

5. 

Difference Deviation (%) 

11.55 


Table 49. Summary of the accuracy of the simulation for coherent 2FSK. 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for 
coherently detected 4FSK are presented in the Figures 166 and 167, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from -5 dB to +30 dB in increments 
of2.5dB. 
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Figure 166. Theoretical symbol error probability versus SNR with SIR as a parameter 
for coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable and 


interfering). 
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Figure 167. Simulation symbol error probability versus SNR with SJR as a parameter 
for coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


In Figures 168 and 169, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 
parameter. 
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Figure 168. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 
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Figure 169. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 50. In Figure 170, the average error for each curve is 
plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 170. Mean percent difference as a function of SNR and SJR, respectively. 

The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

10.995 


Average Mean Difference (%) 

-0.322 

3. 

Maximum Difference (%) 

26.542 

m 

Minimum Difference (%) 

-25.95 

5. 

Difference Deviation (%) 

10.99 


Table 50. Summary of the accuracy of the simulation for coherent 4FSK. 
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c) Results For 8FSK 


The theoretical and the simulation symbol error probabilities for 
coherently detected 8FSK are presented in the Figures 171 and 172, respectively, as 
functions of average SNR in dB with SJR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from -5 dB to +30 dB in increments 
of2.5dB. 
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Figure 171. Theoretical symbol error probability versus SNR with SJR as a parameter 
for coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 
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Figure 172. Simulation symbol error probability versus SNR with SIR as a parameter 
for coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


In Figures 173 and 174, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SIR with SNR as a 
parameter. 
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Figure 173. Theoretical symbol error probability versus SJR with SNR as a parameter 
for coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 
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Figure 174. Simulation symbol error probability versus SJR with SNR as a parameter 
for coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable and 
interfering). 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 51. In Figure 175, the average difference for each curve 
is plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 175. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SIR. 
Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 


(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

8.684 

2. 

Average Mean Difference (%) 

5.598 

3. 

Maximum Difference (%) 

20.848 

4. 

Minimum Difference (%) 

-11.528 

5. 

Difference Deviation (%) 

6.638 


Table 51. Summary of the accuracy of the simulation for coherent 8FSK. 
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Observing the results for coherent detection of 2, 4, and 8FSK in a Rician 
fading channel and affected by AWGN and co-channel interference, we note that the 
simulation underestimates the theory for the cases of 2 and 8FSK and overestimates the 
theory for the case of 4FSK. The root mean square difference (in percent) is about 11% 
(in average) and the mean percent difference for all the cases is about 4%. 


The average results for the coherent detection of 2, 4, and 8FSK are 
presented in Table 52. 


■ 

SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR COHERENT 

2,4, AND 8FSK 

1. 

Root Mean Square Difference (%) 

11.055 

2. 

Average Mean Difference (%) 

4.079 

■ 

Maximum Difference (%) 

24.866 

1 

Minimum Difference (%) 

-20.014 

5. 

Difference Deviation (%) 

9.726 


Table 52. Average results for the coherent detection of 2,4, and 8FSK. 
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D. RICIAN FADING CHANNEL - NON-COHERENT DETECTION 

In this section, we derive the symbol error probability for non-coherent detection 
of MFSK signals transmitted over a frequency-nonselective, slowly fading Rician 
channel in the presence of AWGN and co-channel interference. The Rician fading 
channel affects both the desired and interfering signals. 


1. Theoretical Probability Of Symbol Error For Noncoherent Detection 

The probability that the signal symbol will be received correctly is evaluated, 
again, separately for the following two cases: 

• 1®* case: the signal and the interference symbols are on the same branch. 

• 2 ^^ case: the signal and the interference symbols are on different branches. 

Then, combining the two cases, we evaluate the total symbol error probability. 

a) The Signal And The Interference Symbols Are On The Same 
Branch 

The conditional probability of symbol error for non-coherent, orthogonal 
MFSK signals transmitted through a Rician fading channel, with AWGN and co-channel 
interference has been derived in Chapter V (equation (5.41)): 



where q is the amplitude of the interfering MFSK signal. 
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The above symbol error probability is conditioned on the amplitude rj of the interfering 
signal, which is assumed as a Rician random variable with the probability density 
function: 



(6.32) 


where: 


Pj dir is the power of the direct interfering signal component 
Pj dif is the power of the diffuse interfering signal component. 

Integrating the product of the conditional probability of symbol error and 
the probability density function of the interfering signal’s amplitude rj over all possible 
values of rj, and using the transformation of (6.22) we obtain the unconditional 
probability of symbol error for this case: 



M-1 

S (M-l)! (-l)‘^^\ ^2(k-H) \ ^Pnoise Pnoise/ 

kKM- 1-k)! (k+1) ^ 

k = l 


dydz (6.33) 
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- 2 + 2-R. 


I0[p-R-yJ-e 




The above integral must be evaluated numerically. 
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b) The Signal And The Interference Symbols Are On Different 
Branches 


The conditional probability of symbol error for this case has already been 
derived in Chapter V (equation (5.43)). This is given by: 





Integrating the product of the conditional probability of sjonbol error and the probability 
density function of the interfering signal’s amplitude rj over all possible values of rj and 
using again the transformation of (6.22), we get the unconditional probability of symbol 
error for this case: 



The above triple integral has to be evaluated numerically. 


256 


c) Total Symbol Error Probability 

The total symbol error probability, combining the two cases, is given by: 


T, 1 r,, M- 1 ^ 

P total- ^ 

M M 


(6.36) 


where 1/M is the probability that the transmitted and the interfering symbols are at the 
same branch and (M-l)/M is the probability that the transmitted and the interfering 
symbols are at different branches. 

Substituting equations (6.27) and (6.30) into equations (6.33) and (6.35), 
we are able to evaluate and plot the theoretical symbol error probability as a function of 
SNR, SIR and the ratio of the powers of the direct and diffuse signal components. 


2. Simulink Model and Block Analysis 

The schematic diagram of the Simulink model is the same as the block diagram 
shown in Figure 160 for coherent detection except that the block ‘Coh MFSK demod 
baseband’ has been replaced by the block ‘Non-coherent MFSK demod baseband’. 

3. Simulation Analysis And Performance Verification 

In this section, simulation results are presented in order to verify the performance 
of non-coherent detection of MFSK signal corrupted by AWGN and co-channel 
interference in a Rician fading channel. Each simulation runs until at least 100 errors are 
observed. The data sequences are limited to 10® symbols for each simulation, to prevent 
‘out of memory’ errors. As long as less than 100 errors are observed, the simulation 
sequence is repeated until a sufficient number of errors are counted. 
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a) Results For 2FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 2FSK are presented in Figures 176 and 177, respectively, as 
functions of average SNR in dB with SJR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from -5 dB to +16 dB in increments 
of 1.5 dB. 


P2FSK 

■>.y ^ 

P2FSK 


^2FSK 


^2FSK 

^ 2FSK 

P2FSK 
+- 1 1 
^2FSK 

EhB - B 

P2FSK 


^2FSK 

P2FSK 

^2FSK 


P2FSK 


P2FSK 

^2FSK 

e-e-e 



-5 0 


5 10 

SNR 

m 


15 


16 


Figure 176. Theoretical symbol error probability versus SNR with SJR as a parameter. 
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for non-coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 

As evident from Figure 176 and 177, respectively, the curves tend to 
become flat as SNR increases that is they converge to a constant value determined by the 
value of SIR. The consequence of the signal fading is that the symbol error probability 
does not decrease as fast with the increase in either SNR (along a curve) or SIR (from 
curve to curve) as it does for the case of non-fading signals. 
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Figure 177. Simulation symbol error probability versus SNR with SIR as a parameter 
for non-coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 
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In Figures 178 and 179, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SIR with SNR as a 
parameter. 
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Figure 178. Theoretical symbol error probability versus SIR with SNR as a parameter 


for non-coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable 


and interfering). 
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We note again the dramatic increase in the symbol error probability due to 


Rician fading and co-channel interference. 
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Figure 179. Simulation s 5 imbol error probability versus SIR with SNR as a parameter 

for non-coherent 2FSK, with Rician fading and R=1 for both MFSK signals (desirable 

and interfering). 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 53. In Figure 180, the average error for each curve is 
plotted versus SNR and SIR for each of the 15 previously presented curves. 
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Figure 180. Mean percent difference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR cis parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 2FSK 

1. 

Root Mean Square Difference (%) 

19.325 

2. 

Average Mean Difference (%) 

8.434 

3. 

Maximum Difference (%) 

52.892 

4. 

Minimum Difference (%) 

-129.912 

5. 

Difference Deviation (%) 

17.387 


Table 53. Summary of the accuracy of the simulation for non-coherent 2FSK. 
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b) Results For 4FSK 

The theoretical and the simulation symbol error probabilities for non- 
coherently detected 4FSK are presented in Figures 181 and 182, respectively, as 
functions of average SNR in dB with SIR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from —5 dB to +16 dB in increments 
of l.SdB. 
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Figure 181. Theoretical symbol error probability versus SNR with SIR as a parameter 
for non-coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 
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Figure 182. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 


In Figures 183 and 184, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 
parameter. 
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Figure 183. Theoretical symbol error probability versus SJR with SNR as a parameter 


for non-coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable 


and interfering). 


We note again the dramatic increase in the symbol error probability due to 


Rician fading and co-channel interference. 
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Figure 184. Simulation s 5 nmibol error probability versus SJR with SNR as a parameter 
for non-coherent 4FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 54. In Figure 185, the average error for each curve is 
plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 185. Mean percent difference as a function of SNR and SIR, respectively. 


The two curves show how the mean difference varies with SNR and SIR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SIR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 4FSK 

1. 

Root Mean Square Difference (%) 

19.771 

m 

Average Mean Difference (%) 

12.131 

3. 

Maximum Difference (%) 

50.398 

II 

Minimum Difference (%) 

-101.574 

a 

Difference Deviation (%) 

15.612 


Table 54. Summary of the accuracy of the simulation for non-coherent 4FSK. 
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c) Results For 8FSK 


The theoretical and the simulation symbol error probabilities for non- 
coherently detected 8FSK are presented in the Figures 186 and 187, respectively, as 
functions of average SNR in dB with SJR as a parameter. The values for the signal-to- 
noise and signal-to-interference ratios were chosen from -5 dB to +16 dB in increments 
of l.SdB. 
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Figure 186. Theoretical symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 
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Figure 187. Simulation symbol error probability versus SNR with SJR as a parameter 
for non-coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 


In Figures 188 and 189, respectively, the theoretical and simulation results 
for the symbol error probability are presented as functions of SJR with SNR as a 
parameter. 
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Figure 188. Theoretical symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 


We note again the dramatic increase in the symbol error probability due to 
Rician fading and co-channel interference. 
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Figure 189. Simulation symbol error probability versus SJR with SNR as a parameter 
for non-coherent 8FSK, with Rician fading and R=1 for both MFSK signals (desirable 
and interfering). 


The relative difference (percent “error”) between the theory and the 
simulation is presented in Table 55. In Figure 190, the average error for each curve is 
plotted versus SNR and SJR for each of the 15 previously presented curves. 
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Figure 190. Mean percent diflference as a function of SNR and SJR, respectively. 


The two curves show how the mean difference varies with SNR and SJR. 


Each value of the mean difference is the average of the differences that correspond to the 
15 points on each of the 15 curves for the symbol error probability as a function of SNR 
(with SJR as parameter) and SJR (with SNR as parameter), respectively. 



SYMBOL ERROR PROBABILITY 

NON-COHERENT 8FSK 

1. 

Root Mean Square Difference (%) 

16.827 

2. 

Average Mean Difference (%) 

5.633 

3. 

Maximum Difference (%) 

47.421 

4. 

Minimum Difference (%) 

^^105.789 

5. 

Difference Deviation (%) 

15.856 


Table 55. Summary of the accuracy of the simulation for non-coherent 8FSK. 
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Observing the results for non-coherent detection of 2, 4, and 8FSK in a 
Rician fading channel and affected by AWGN and co-channel interference, we note that 
the simulation underestimates the theory for all of the cases of 2, 4, and 8FSK. The root 
mean square difference (in percent) is about 18% (in average) and the mean percent 
difference for all the cases is about 9%. 


The average results for the non-coherent detection of 2, 4, and 8FSK are 
presented in Table 56. 


■ 

SYMBOL ERROR PROBABILITY 

AVERAGE RESULTS FOR NON¬ 
COHERENT 2,4, AND 8FSK 


Root Mean Square Difference (%) 

18.641 

2. 

Average Mean Difference (%) 

8.733 

3. 

Maximum Difference (%) 

50.237 

B 

Minimum Difference (%) 

-112.425 

5. 

Difference Deviation (%) 

16.285 


Table 56. Average results for the non-coherent detection of 2,4, and 8FSK. 
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VII. SUMMARY AND RECOMMENDATIONS 


A. SUMMARY 

In this thesis the probability of symbol error is quantified for coherent and non¬ 
coherent detection of M-ary frequency-shift keyed (MFSK) signals affected by another, 
interfering, MFSK signal (co-channel interference), and additive white Gaussian noise 
(AWGN) in a fading channel. 

First, the symbol error probabilities for coherent detection of 2FSK, 4FSK, and 
8FSK have been determined by theoretical expressions as functions of SNR and SIR. 
Then, the same symbol error probabilities have been determined by performing time 
domain simulations based on SMULINK and MATLAB/SIMULINK Communications 
Toolbox. Finally, the theoretical symbol error probabilities have been compared with the 
simulation results, the differences between them have been presented and the possible 
causes of these differences have been discussed. 

All the theoretical expressions derived in Chapters IV, V, and VI as well as the 
closed form solutions in Appendices A, B, and C are original and their derivation was 
based on the concepts of coherent and non-coherent detection of MFSK signals. 

The overall statistics for the difference (percent “error”) between the theory and 
the simulation are presented in Table 57. The presented total results have been derived by 
averaging the statistics over Jill the values obtained for each case of MFSK detection. 
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SYMBOL ERROR PROBABILirY 

TOTAL RESULTS FOR 2,4, AND 8FSK 

■ 

Root Mean Square Difference (%) 

15.3756 

2. 

Average Mean Difference (%) 

8.1325 

3. 

Maximum Difference (%) 

38.4691 

1 

Minimum Difference (%) 

-45.0895 

5. 

Difference Deviation (%) 

13.3638 


Table 57. Overall statistics for the difference between theory and simulation of the 
detection of 2,4, and 8FSK with AWGN and co-channel interference in fading channel. 


The simulation required computational time to obtain values of the symbol error 
probability as small as lO'"^ for 100 or so errors was about 3-4 hours maximum (on a 600 
MHz PC). The numerical evaluation of the theoretical expressions, using MATHCAD8, 
required several seconds minimum and 7-8 hours maximum time (on a 600 MHb: PC). 

B. RECOMMENDATIONS 

The phase shift between the interference and the desired signal affects the 
detection process only for the case of the desired signal and the interference on same 
branch. In this work the assumption was made that the interference carrier has the same 
phase as the desired signal carrier, that is their phase difference has not been 
implemented in the Simulink model and not accounted for in the theoretical calculations. 
Inclusion of the phase difference between the carriers of the interfering and the desired 
signals adds another random variable to the model and increases the model complexity 
further, but it also represents a more realistic case. Further work should include the 
addition of a random variable representing the phase difference. The most likely case 
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would be that the phase difference is represented by a uniformly distributed random 
variable (between 0 and 2 %). 

Also, various ratios of the direct and diffuse powers (R) should be considered for 
the Rician interference model. In this work the special case R=1 (equal direct and diffuse 
powers) was considered. Note that the case of Rayleigh distributed interference and the 
case of constant interference power are the limiting cases when R tends to 0 and R tends 
to infinity, and these case have been addressed here. Nevertheless, it would be of interest 
to consider several cases of R between 0 and 1 (say 0.5, 0.25, etc.) and several cases of R 
between 1 and infinity (say 2,4, etc.). 
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APPENDIX A. CLOSED FORM SOLUTION FOR THE SYMBOL ERROR 
PROBABILITY OF COHERENT BFSK WITH AWGN AND CO-CHANNEL 
INTERFERENCE 

1. The Signal And The Interference Symbols Are On The Same Branch 
The symbol error probability for coherent detection of MFSK with AWGN and 
co-channel interference with the signal and the interference symbols on the same branch 
of the receiver is given by equation (4.7). Applying M=2, we obtain the corresponding 
expression for BFSK; 

dx 



We recall the following identities; 



(A2) 
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Applying (A2X (A3), and (A4) to equation (Al), we find the closed form solution; 



Using (4.16), we express PI as a fimction of SNR and SJR; 

/ SNR- SJR \ 

P1=Q\10^®+10 / 


(A5) 


(A6) 


2. The Signal And The Interference Symbols Are On Different Branches 
The symbol error probability for coherent detection of MFSK with AWGN and 
co-channel interference with the signal and the interference symbols on different 
branches of the receiver is given by equation (4.14). Applying M=2, we obtain the 
corresponding expression for BFSK: 




l-Q^x-h 



dx 


(A7) 


Applying (A2), (A3), and (A4) to equation (A7), we find the closed form solution: 

P2=Q-— (A8) 

\^2-aj 

Using (4.16), we express P2 as a function of SNR and SJR; 

I SNR- SJR \ 

P2=Q\iO^®-10 / (A9) 
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3. 


Total Symbol Error Probability 


Applying (A6) and (A9) in (4.15), we find the symbol error probability for BFSK: 




SNR 

20 


+ 10 


SNR- SJR\ 
20 


/ SNR SNR- SJR\ 


1 


20 


+ —Q\10 - 10 

2 


20 


(AlO) 
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APPENDIX B. CLOSED FORM SOLUTION FOR EQUATION (5.15) 


We recall equation (5.15) for the symbol error probability for non-coherent 
detection of MFSK signals transmitted over a frequency nonselective, slowly fading 
Rayleigh channel in the presence of AWGN and co-channel interference with the signal 
and the interference symbols on the same branch of the receiver (case 1): 


(M-1)! (-l)’"'^* \ Jp 




k!-(M-l-k)! k + l 


s'g . J 2 

=+ 1=1 ^ 
noise noise I .q ^ .y (Bl) 


Moving the integral inside the summation and rearranging the terms, we obtain; 


M-1 ^ , ^noise 

Pl= y (M-1)! (-l)^^\ ^2(k-H) 

k!(M-1-k)! k+1 


^ noise 1 2 ^ noise 

y.gL2-(k+l)‘^2j^ [ k+1 J^jy(B2) 


We recall the following identity; 


Jo 2 



We let; 



P • p • 

noise 1 ^ noise 

p=-+ - q=- 

2-(k+l) 2 k+1 


(B3) 


(B4) 
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Applying (B3) and (B4), for n equal to 1, into (B2), we find the closed form solution: 


M- 1 


k=l 



P • 

^ noise 

(M-i)! 

kKM-1-k)! 2-(k+l) ^ 



(B5) 


Substituting back the values of p and q (equations (B4)) into (B5), we obtain: 
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APPENDIX C. CLOSED FORM SOLUTION FOR EQUATION (5.41) 

We recall equation (5.41) for the symbol error probability for non-coherent 
detection of MFSK signals transmitted over a frequency nonselective, slowly fading 
Rician channel in the presence of AWGN and co-channel interference with the signal and 
the interference symbols on the same branch of the receiver (case 1): 


-k . / 2 phJ 

^ ^ k+1 2-(k-i-l) I — 'y - 

y (M-l)! .(-1) 1 Pdif 

kKM-1-k)! (k+1) ® ® 

k=l 


(M- 1)! 1 I 2 Y PdiflJ.L Pdir 


•10 2 ---y -y dy 


For practical purposes we define the following constants: 


Using (C2) and moving the integral inside the summation, we obtain; 


(M-l)! 2-(-l)' 


1 = y (M- 

^ kKM-l-k)! 


k+l \ I 2 

L2-lk-a+k+t 


V2-(k+lHk-a+k+i;j 

At, 




f -^k+1 j 

He - 1 =-y: 


Jk-a +k+ 1 


We recall the identity: 


00 1 


io(x)= Y, 


n“0 
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Substituting (C4) into (C3), we obtain: 


M* 1 00 

-EE 



J 


k<xb 

Y-b- 

2<-l)‘^^‘ 

2-(ka^k+l) J /lfl c<k+l) ]" 


J2<kb l>(k<x^+kb l) 

' (k-a^tkt l) 

k<x^+k+l , 

6 

0 



Now, we make the following transformation of variable: 

k-a-b 

__ 


where y is constant. 
So, (C5) becomes: 


:=y + Y 


2.(k-i-l).(k-a +k-Hl 


y y (M-D! ] c-(k4-l) f 

Aj Li 2 . ^ 'Ll '. ? . 




*00 

P 2 

‘Z f x2ntl 


e -(z-yr'^-^ciz (C 7 ) 


To evaluate the integral of the above expression, we recall the binomial identity: 


(z-y) 


m = 0 

Applying (C8) to (C7), we obtain: 

M - 1 00 2 -n+ 1 


2-n+l 

2n+l_ (2-n-f-l)! x2n+l-m^m 

4Lj m!-(2n+l-m)!'^'^^ 


SEE 




2‘ \k‘CX *f- k-h 1 


^ ^ ^ k!-(M- 1 -k)! (k 2 , , 

PU k = l n =0 m = 0 ^ +^ + 1 


1 I _ C-(k + 1 ) ( 2 -n+l)! s2n+l-m 

”•/ k-a^ + k + 1 ni!-( 2 -n+ 1 -m)! ^ 


-z m j 

e -z dz 
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Now, the integral of (C9) has the following solution: 


-z m j ^ -r / ^ ^ ^ 

e -z dz=—T—m +—,Y 

2 \2 2 , 


(CIO) 


Substituting into (C9), we get: 


M- 1 00 2-n+l ^ j -— - -rt 

yi yi y (M-i)! (-1)^ ^[2-(k-a+k-i-i) 

PI- t , n n 

k=l n=0 m=0 ^ ^ 

c(k+l) (2-n+l)! 2•n+l-mp/ m•^l 2 \ 

k-a^ + k+l m!-(2-n-t-l-m)! \ 2 ’ / 


(Cll) 


The complementary incomplete gamma function r(m+l/2,Y) is given by ((2.46) of Ref 
[9]): 


KJJ - 


P = 0 p!- P + 


(C12) 


The gamma function in (C12) is given by ((2.4) and (2.25) of Ref [9]): 

r(^)=(i^^)! form=l,3,5,7,9,... 


(C13) 


/m+ 

, m! , 

\ 2 1 

1 

u, 


2 • 

V2 ■ 


for m=0,2,4,6,8,... 


(C14) 
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